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APPLICATIONS OF FEATURE SELECTION 

1 . INTRODUCTION 

A practical application of remote sensing which is of considerable 
interest is the use of satellite-acquired (LANDSAT) mul tispectral scanner 
(MSS) data to conduct an inventory of some crop of economic interest 
such as wheat over a large geographical area. Any such inventory 
requires the development of accurate and efficient algorithms for data 
classification. The use of multi temporal measurements (several 
registered passes during the growing season) increases the dimension of 
the measurement space and thereby increases the computational load for 
a classification algorithm. When statistical pattern recognition 
techniques are used in classification algorithms, one method for reducing 
the dimensionality of the problem is by the use of feature selection/ 
combination techniques. 

Theoretical results pertaining to minimizing the probability of 
misclassification for linear feature selection were initially obtained 
by Guseman and Walker [1], [2]. A computational procedure was developed 
(see [1], [3]), for the case of two n-dimensional multivariate normal 
populations with equal a priori probabilities and a one-dimensional 
feature space. Theoretical results for the general case of m 
n-dimensional multivariate normal populations with arbitrary a priori 
probabilities and a k-dimensional feature space (k < n) appear in 
[6], Development of a computational procedure for the special case 
k = 1, based on the results obtained in [6], was initiated in December 
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of 1973, and completed January 1975 under a previous contract (see [4]). 
During this same period, a preliminary investigation was initiated which 
involved the application of feature selection to estimation of proportions 
(see [5] ). 

Additional feature selection algorithms based on other criteria 
(e.g. divergence, Bhattacharyya, etc.) allowing transformation from n 
to k dimensions (k > 1) have been developed at the University of Houston. 
Investigations carried out under this contract were concerned with 

Extending the feature selection procedure of [4] to the 
case where the density function for each population is a 
convex combination of multivariate normals. 

Application of the extended feature selection procedure to 
the problem of estimating the proportions of "WHEAT" and 
"NON-WHEAT" in a given sample segment. 

Application of feature selection to color display of multi- 
channel images. 


Each of these investigations is discussed in turn in the sequel. 


2. EXTENDING FEATURE SELECTION PROCEDURE 


The feature selection program (LFSPMC) was extended to treat the case 
where the density function for each population is a convex combination of 
multivariate normals. Additional modifications were made to the program 
to allow for simpler data set-up and program operation. The feature 
selection method formulation, associated computational technique, and 
users guide for the program are contained in 

L.F. Guseman, Jr., and Bruce P. Marion, LFSPMC (Version 2): 

Linear Feature Selection Program Using the Probability of 
Misclassification, NASA Contract NAS-9- 14689-4S, Texas A&M 
University, Department of Mathematics, Report #6, March 1976. 
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The new version of LFSPMC is capable of working with several 
populations, each of whose density functions is a convex combination of 
multivariate normals. 

Additions to the program include internal computation of the program 
parameters which set limits on the number of iterations through the 
optimization algorithm and provide the initial guess for the minimum 
of the objective function. 

The computational procedure for providing the starting vectors to the 
optimization algorithm does not appear to work well when several component 
classes are combined into one single convex combination. This situation 
is still being investigated. 
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3. ESTIMATION OF PROPORTIONS 

Investigations were carried out which led to the formulation and 
implementation of computational procedures which treat the following 
problem: 

Given LANDSAT data (mul ti temporal ) over a LACIE sample segment, 
and representative samples of the classes present in the 
segment, estimate what proportion of the sample segment is 
in WHEAT. 

The approach to the above problem taken in the investigations can be 
summarized as follows: 

(a) The density function for each of the classes WHEAT 
and NON-WHEAT is expressed as an appropriate convex 
combination of multivariate normal densities with 
known means and covariance matrices (usually obtained 
from a training sample). 

(b) Feature selection is performed (using LFSPMC (Version 2)) 
to produce a corresponding optimal one-dimensional 

Bayes classifier for WHEAT VS. NON-WHEAT whose associated 
confusion matrix is computable. 

(c) Using the one-dimensional classifer and associated 
confusion matrix, an estimate of the true proportion 
of WHEAT in the sample segment is made. 
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The mathematical formulation of the estimation of proportions 
procedures, along with numerical" results appear in 

L.F. Guseman, Jr. and Jay R. Walton, Methods for estimating 
proportions of convex combinations of normals, NASA Contract 
NAS-9-1 4689-4S, Texas A&M University, Department of Mathematics, 
Report #7, April, 1976. 

The methods presented in the above report have the advantage that 
classification of multi temporal data over a sample segment is performed 
optimally in one-dimensional space thereby reducing significantly the 
computer time spent in classification. Another advantage is that the 
confusion matrix, used in obtaining unbiased estimates of the WHEAT 
proportions, can be readily computed without/ the costly requirement of 
obtaining a labeled sample Independent of the training sample. 

The estimation of proportions procedures were implemented (Program 
ESTPRO), and tested using MSS measurements (four registered passes) from 
Hill County Montana. The preliminary results appear to be quite good. 

In one case (ESTIMATOR 4), two unbiased estimates are available depending 
on the choice of sign. At present, there is no automatic rule which 
dictates the choice of sign. Instructions for use of ESTPRO appear in 

L.F. Guseman, Jr., Bruce P. Marion and Manot Swasdee, Users Guide - 
ESTPRO: Estimation of proportions program using feature selection, 

NASA Contract NAS-9-1 4689-4S, Texas A&M University, Department of 
Mathematics, Report #8, May, 1976. 

An additional investigation into the problem of formulating 
minimum variance unbiased estimators was performed. Preliminary results 
were obtained for the special case of two multivariate normal populations. 
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Results of this investigation appear in 

Jay.R. Walton, Observations on minimum variance proportion 
estimation, NASA Contract NAS-9-14689-1 S, Texas A&M 
University, Department of Mathematics, Report #5, February, 1976. 

Preliminary numerical results based on results in this report indicate 
a sensitivity to the choice of variance-like function being minimized, 
as well as a dependence on the sample being used in the proportion 
estimation portion. In addition, no results are yet available which 
indicate how one might extend the above work to the "WHEAT" vs 
"NON-WHEAT" problem. 


t 
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4. COLOR DISPLAY OF MULTICHANNEL IMAGES 

A common problem for an image analyst-photo interpreter (AI) is 
the analysis of multichannel images of high dimensionality. For example, 
satellite acquired multi spectral scanner data from several temporal passes 
may be twelve or more dimensional. Current color display techniques allow 
split-screen displays of up to twelve channels (for up to 16-dimensional 
four pass LANDSAT data). However, most AI work is restricted to one 
pass data owing to interpretation, display and data management problems. 

For many applications, one pass is enough. However, recognition of 
crops (for example, for the ultimate purpose of a large area crop inventory) 
by statistical pattern recognition techniques requires more than one pass 
data to achieve acceptable performance. If these techniques are applied 
in the original space (of, say, twelve dimensions), computational problems 
become severe. Feature selection techniques furnish methods of reducing 
the dimensionality of feature space which preserve (in some sense) data 
separation, making computationally feasible refined pattern recognition 
techniques. 

Of course, an AI is not a computer. The AI can 

(i) make use of subtle spatial relationships to recognize 
fields which a computer would "see" as all boundary 
(for instance, the long narrow fields of crops 
alternating with fallow in dry areas) 

(ii) pass over large areas (urban, forest) at a glance 

(iii) adjust subjectively for differing soil types, 

agricultural practices, sun angle (signature extension) 

All these tasks are difficult for the computer. By making use of his 
special abilities, an AI using one pass data will compete favorably with 
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the best automatic pattern recognition techniques. Even so, it seems that if 
multitemporal data can be reduced in size and displayed like one pass 
data in a predictable form, then the accuracy of the AI product must 
increase. 

The reports 

Jack D. Bryant, David Nobles and Manot Swasdee, Computer 
Program Documentation: Program N0NLN1 and N0NLN2 - Nonlinear 

Color Display Program, NASA Contract NAS-9-14689- 4S, Texas 
A&M University, Department of Mathematics, Report #9, May, 1976 

Jack D. Bryant, David Nobles and Manot Swasdee, Computer Program 
Documentation: Program R0TAT1 and R0TAT2 - Rotation To 

Produce Color Displays, NASA Contract NAS-9-1 4689-4S, Texas 
A&M University, Department of Mathematics, Report # 10, May, 1976 


discuss first efforts to accomplish a reduction of 12 dimensional data 
to 4 dimensional data in a form which can be displayed in the same 
manner as one pass data is currently being displayed. The detailed 
description of our methods appear there. Here we discuss in a general 
way the idea of generating one pass LANDSAT-like data from the output 
of a linear feature selection program mapping multitemporal LANDSAT 
data feature selection program to 4 dimensions. 

Several problems exist which make transformed (by a linear feature 
selection procedure) data unlike one pass LANDSAT data. 

1. The transformed data consists of a four vector of real 
numbers. How can the transformed data be displayed at 
all on a device which expects input data to be 6 or 7 
bit (unsigned) integers (that is, fixed point numbers 
in the range 0-63 or 0-127)? 
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2. The transformed data has a much larger range than 
agricultural information occupies. How can the data 
be quantized without losing agricultural information? 

3. After transformation, the data has no intrinsic meaning. 

That is, feature selection programs produce a transformation 
which optimizes some measure of separation. Obviously the 
transformation is not unique. If problems 1. and 2. are 
solved somehow, how can colors be assigned to the scaled 
data so that comparable colors result when different 
feature selection transformations are applied? 

Problems 1. and 2. are easily solved. The idea is to find what happens 
to the mean vectors of the classes the feature selection program was trained 
on. We allow some variation, and define two 4-hyperrectangles: one, which 
is used to define a map into a unit 4-cube, has its corners defined by the 
maximum over all classes of means plus standard deviation sigma (square 
root of diagonal element in covariance matrix for that class and transformed 
channel) and minimum of means minus sigma; and another, which is used to 
test for data with probably no agricultural significance by corners maximum 
over all classes of mean plus 3 sigma and minimum of mean minus 3 sigma. 
Figure 1 (see following page) plots the image in a unit 3-cube of transformed 
means we found in test data generated from Hill County North data using 
the UH Feature Selection Program. (Of course, there are four dimensions 
in actual transformed data.) 
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This data could now be scaled and displayed. However, it would be 
little help to an AI unless there were some way to predict which color 
represented which class. (In the current example, 1 is GRASS and 5 is 
WHEAT.) This is the point of problem 3: how can colors be assigned 

consistently? We motivate our choices as follows: 

a. In all scenes which we have viewed, at least one class 
which we have viewed is GRASS. 

b. There will usually be one class in which there is more 

interest than in others: for instance, WHEAT. 

c. The colors red and green seem to carry more subjective 
information than blue. Hence we want to make the class 
we have most interest in (WHEAT) red and another class 
which is nearly always present (GRASS) green. 

(The statement in c. is misleading. We are not trying to produce a 
classification map; we only produce an enhanced display.) 

The two methods we investigate (and which are described in detail in 
the above reports) are quite different but accomplish somewhat the same 
thing. One starts out being a composition of rotations which ends up 
with WHEAT along the "red" axis and GRASS in the "red-green" plane; 
some nonlinear scaling is then applied to improve this result. The other 
starts out being highly nonlinear (and somewhat noise-succeptable) , but 
is much more efficient in computer time usage. Both do well making 
WHEAT red; we think R0TAT1-2 (the rotation-based method) is best. 
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1.0 INTRODUCTION 


The problem of classification arises when an observer must 
determine the class of an object by investigating a set of measure- 
ments or features taken from the object. It is assumed that the object 
belongs to one of a finite number of classes (e.g. crops) and that 
each class is described by a probability distribution of its measure- 
ment vectors. It is also assumed that combinations of classes can be 
defined as convex combinations of the associated density functions. 

When the dimension of the measurement vector is high and a large number 
of objects are to be classified the computational load increases signifi- 
cantly. As a result, one employs feature selection techniques which 
allow classification in spaces of lower dimension while preserving as 
much as possible the discriminatory power inherently available in the 
original measurements. 

In the sequel we discuss the computational procedure and associated 
computer program for a linear feature selection technique. The technique 
assumes: 

1. A finite number, m, of convex combinations of classes 

2. Each class is described by an n-dimensional multivariate 
normal density function of its measurement vectors. 

3. The mean vector and covariance matrix for each density 
function are known (or can be estimated). 

4. The a priori probability for each class and for 
each convex combination of classes is known. 
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... The technique produces a single linear combination of the original 
measurements which minimizes the one-dimensional probability of mis- 
classification defined by the transformed densities. The procedure for 
two classes with equal a priori probabilities was developed in [3]. 
Subsequent theoretical results from [4] and the original version of 
LFSPMC discussed in [6] form the basis for the procedure described 
herein. The computational procedure and a description of the associated 
computer program appear in Section 3.0. Procedures for using the pro- 
gram appear in Section 4.0. Section 5.0 contains example input and 
output. 
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2.0 MATHEMATICAL PRELIMINARIES 


Let n , n be distinct classes (e.q. crops of interest) 

1 2 l 

with known a priori probabilities a , a , ...,a, , respectively. Let 

12 

x = (x ,x ,...,x )"*" e E n denote a vector of measurements (e.q. LANDSAT 
12 n 

multi spectral scanner data from either a single pass or several 

registered passes) taken from an arbitrary element of U n. . Suppose 

1=1 1 

that the measurement vectors for class IT. are distributed according to 
the n-dimensional multivariate normal density function 


P i (x) = (2ir)' n/2 |E i . r' /4 exp 


■ 1 / 2 . 


- J-(x-P i (x-r. ) 


1 < i < L 


We assume that the n*l mean vector vn and the nxn covariance 

matrix for each class are known with E.. positive definite, 

1 < i < L. The symbol |A| is used to denote the determinant of the 
matrix A. 

Given the partition* 


(l,2,...,k ,k +],...,k ,k +1 ,. . . ,k. ,k.+l . ,k } 
i i 2 2 i t m 


of {1,2,...,L} into m subsets, let 

k i 

r. = u n. , i = 1 ,2,. . . ,m, 

J=k i-1 +1 J 


where k = 0 , k = L , and let m. = k. - k. , 
o m i I i—i 


Then r. has a priori probability 


*The program allows an arbitrary partition of the L classes into 
convex combinations. We assume the ordered partition defined herein 
only for purposes of simplifying notation in the discussion. See Example 2, 
Section 5.0. 
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k. 


y. •• £ ot • > i 1 » • • • ,m. 

' -i=i/ J 


Letting 

h. 


j=k i-i +1 


k ,- 


a. 


= l e 1 Pj , 1 5 i 5 m 

J =k i_] +1 Yi J 


we see that each h^ is a convex combination of multivariate normals. 

L 

The mixture density for u n. in terms of the combinations of classes 

3=1 J 

r. , i = is easily seen to be 

m 

h = l Y i h i . 
i=l 1 1 

Since, in general, the a^'s are unknown (and consequently so are the 

■J 

y.. 1 s ) , we allow for the specification of the a priori probabilities 

3 for 1^,.. . ,r m , respectively; that is, we assume the 

expression for h given by 
m 

h = l &.h . 

i=l 1 1 

The n-dimensional probability of misclassification, denoted by PMC, 

m 

of objects from U r. is given (see II]) by 
i=l 1 


PMC = 1 - J max B.h.(x)dx 
£ n l<i<m 11 


m 

= 1 - l B i J (x)dx , 

1=1 n 
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where the sets , 1 < i < m , called the Bayes 1 decision regions , 
are defined by 

R. = {x e E n | 3. h. (x) = max B- h. (x) } , 1 < i < m . 

1 1 1 1 <j <m J J ‘ " 

The resulting classification procedure, called the Bayes 1 optimal 
classifier , is defined as follows: 

Assign an element to I\ if its vector x of 
measurements belongs to R^ . 

If B = (b , . . . ,b ) is a nonzero Ixn vector and x £ E n , 

then y = Bx e E 1 and the transformed measurement vectors y = Bx 
for class IL are distributed according to the univariate normal 

density function (see Ml) given by 

2 

l/o t - 1 /? (y “ By. ) 

p,(y,B) = (2 tt) '^(BZ.B 1 ) l/ exp , 1 < i < L . 

2B£.jB " " 

The transformed density for f. is given by 
k. 

i a, 

h.(y,B) = l , i<i<m 

1 j=k. +1 Y '' J 

1-1 

m 

The probability of misclassification g of an object from U T • 

i=l 1 

in terms of the transformed measurements y = Bxe E 1 , as a function 
of nonzero B, is given by 
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g(B) = 1 - J max 0. h.(y,B) dy 
E 1 ] - i - m 

m 

= 1 - I 6, / h.(y,B) dy , 

i=1 R,(B) 

where the transformed Bayes' decision regions are given by 

R,(B) = ye E 1 | 0. h.(y,B) = max 0. h.(y,B) , 1 < i < m . 

1 I 11 1 <y<m J J ) " 

We use G(B) to denote the probability of correct classification for 
B. 

The computational procedure and associated computer program 
described in the sequel present a method for determining a nonzero l*n 
vector B which minimizes g, or equivalently, which maximizes G. 

The method yields a linear feature selection procedure in that classi- 
fication is ultimately performed in E 1 using only a single feature; 
namely, an optimal linear combination of the original measurements. 

The classification procedure in E 1 is described as follows: 


If B is a nonzero l*n vector which minimizes g, 
then assign an object to r. if, for its measurement 
vector x, Bx e R ^ ( B ) . 


Following arguments similar to those presented in [4], we obtain 
the expression for the Gateaux differential (see [7], [4]) of G 
(when it exists) given by 


<S'G(B 


m 


a ■ 


■»c) = - l e. I ■ ~~ p • ( y , 

i=l 1 j=k i l +l Y i J 


B) 


ry D • 

Tr <y' Bu i> + Cll i 


BZ i B 


R-j(B) 
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where the notation denotes the sum of the values of the 

R^B) 

function at the right endpoints of the intervals comprising R..(B) 

minus the sum of its values at the left endpoint. 

If B is a nonzero 1 n vector which minimizes g(B) = 1 - G(B), 
then B must satisfy the vector equation 


<5g(B;C ) 



<Sg(B;C n ) 



where C., 1 < j < n , is a l*n vector with a one in the j th slot 
J 

and zeros elsewhere. Using the formula for —■ resulting from the 

OD 

above expression, and using the fact that ||- = - ||- , we obtain a 


numerically tractable expression for the variation in the probability 
of misclassification g with respect to B. The use of this ex- 


pression in a computational procedure for obtaining a nonzero B 
which minimizes g is discussed in subsequent sections. 
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3.0 COMPUTATIONAL PROCEDURE 

The computational procedure for determining the nonzero l*n 
vector B which minimizes the probability of misclassification g with 
respect to the one-dimensional transformed density functions is embodied 
in the FORTRAN program LFSPMC (VERSION 2). 

Apart from the various program parameters and command cards 
(discussed in the sequel), the basic input data to the program consists 
of the class names, mean vectors and covariance matrices which comprise 
the class statistics deck . All input data to the program is from unit 
reference 5 (usually punched cards). All output from the program is 
printed on unit reference 6. Several additional options are built 
into the program which provide the user with the capability of making 
successive runs using designated subsets of the original classes or 
features already provided by the class statistics deck. 

The program is divided into the following four subsections which 
are discussed in turn in the sequel: 

Parameter Initialization 
Initial Vector Determination 
Optimization Algorithm 
Computation of g(B) and ||j- 

3.1 Parameter Initialization 

All input variables to the program are of a fixed format and must 
be entered as shown in Section 4.0 and as illustrated in the examples 
in Section 5.0. These variables are: 
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MC . . . . : 

N . . . . : 

CLS . . . : 

MTOT . . . : 

NFPC . . . : 

KCLS . . . : 

IFEA . . . : 

COVARB . . : 

XMEANB . . : 
APROB. . . : 

BETA . . . : 

ICMB . . . : 


Number of convex combinations of classes, <MTOT. 
Dimension of feature space, <NFPC. 

Class names, 12 characters, double subscripted 
array. 

Number of classes in the .class statistics deck. 
Number of features per class in the class 
statistics deck. 

Numeric labels of the designated classes from 
the MTOT classes in the class statistics deck, 
single subscripted array. 

Numeric labels of the N designated features 
from the NFPC features in the class statistics 
deck, single subscripted array. 

Input covariance matrices, triple subscripted 
array. 

Input mean vectors, double subscripted array. 

A priori probabilities for the component classes, 
single subscripted array. 

A priori probabilities for the MC convex 
combinations, single subscripted array. 

Numeric labels of component classes as defined 
in vector KCLS used in defining convex combinations 
(Need not be in ascending order, see Example 2, 
Section 5), double subscripted array. 
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Four command codes select program options as follows: 

STAT - definition and entry of a given statistics deck, 

FEAT - definition of a desired subset of features from the 
current statistics deck, 

COMB - definition of convex combinations of a subset of class 
of the current statistics deck, along with associated 
a priori probabilities for the convex combinations and 
component classes. 

FSEL - computation of the Ixn transformation vector which 
minimizes the PMC expression. 

When the STAT command is used, values of MTOT and NFPC for the 
new statistics deck are entered. The names for the respective classes 
in the statistics deck are defined on succeeding cards. The class 
statistics deck, comprised of the MTOT mean vectors in the order of 
ascending class numbers followed by the MTOT covariance matrices in the 
order of ascending class numbers, is entered. The entries of each 
mean vector in the order of ascending feature number are entered 
according to the format (5X, 5D15.8). The NFPC(NFPC + l)/2 elements 
on and above the diagonal of each covariance matrix are entered by 
column in the format (5X, 5D15.8). It is assumed that the diagonal 
elements of each covariance matrix are in order of ascending feature 
number. The first entry of each new mean vector or covariance matrix 
starts on a new card. The entire statistics deck with appropriate 
class names is printed. 

If the FEAT command is selected, a new value for N and the 
numeric labels of the desired features (IFEA) are entered and printed. 
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The COMB command requires entry of the numeric labels and a priori 
probabilities of the desired component classes defining each convex com- 
bination. After each combination is defined, the a priori probability 
for the combination is entered. The names of the classes defining the 
combinations and the a priori probabilities are output. Parameters 
initialized using the STAT, FEAT, and COMB commands remain in effect 
until the respective command is again used. 

The FSEL command requires the input of 

IZ : initial B-vector flag 

= 0 compute the initial vector. B t for the 

- 0 

optimization algorithm. 

= 1 input the initial vector B . 

0 

The FSEL command must be preceeded by the STAT and COMB commands. 

3.2 Initial Vector Determination 

A nonzero l*n vector B which minimizes g cannot, in general, 

o 

be obtained in closed form, and a numerical optimization (minimization) 
procedure is required. Any such optimization algorithm must be given 

an initial vector B . 

o 

When the initial vector B is to be computed, SUBROUTINE BCOMP 

o 

is called. For the special case of two multivariate normal classes 

with equal a priori probabilities, B is computed in SUBROUTINE 

o 

BC2CP using the formula (see [3], [4]) 

B = (y -y ) T (Z +E f 1 
0 12 .12 



In all other cases the initial vector is computed using the procedure 
described below (see [5], [9]). 

Given a.. , y^ , and E. , 1 < i < L , let 

1 ■ r ,1, “i 

and determine (using SUBROUTINE EIGEN see [10]) an nxn matrix A such that 
A E A T = I. Letting n. = Ay.. , 1 < i < L , the problem can then be 

reduced to finding a fixed point of the function H defined as follows: 

For a given l*n vector C, choose indices i . , 1 < j < L , for 

J 

the rij ' s and cu 's such that (< indicates ordering of intervals) 

R. (C) < R. (C) < ... < R. (C) , 

\ \ 1 L 

where 

R- (C) = y I a. p. (y,C) = max a. p. (y,C) 

'j ( ’j ’j l<k<L \ n k 

k^j 

To determine the regions R^ (C) , the roots between transformed 


densities considered pairwise are computed as 
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Once all the roots a. (C) have been found, the regions R. (C) 

'j 'j 

j = 1,2,...,L are defined by the following ordering: 

a) Choose i such that 

1 

Cp. = min Cp. 
n l l<j<L 3 

b) Choose i such that 

2 

1<J*<L 3ji x 

c) Given i and i , choose i such that 

12 3 

a . . = min < a - . la.. > a . . > 

1 1 J 1 11 

3 2 I 5 L 1 2 2 2 1' 

d) In general choose i. + , such that 

a . = min a.. |a.. > a. . 

Vl ’k 1 <j<L ( J1 k J1 k W-V 


provided 


a., la.. >a. • 

1 J1 k J1 k 1 k 1 k-1 i 


If the above set is empty, the procedure is terminated. 
For 


ln/a. /a. ^ c/p . +p \ 


we let 


L -! 

F(C) = l a. p. (a . ,C) (p. -p. ) . 

’i 'j 3 ’i+i ’j 
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Then 


H(C) = 


F(C) T 
1 1 F(C) T | | 

2 


To find a fixed point of H (C = H(C)), we let C = n . - n . , 

o i J 


where 


n, - ti. 


max | |n - n 1 1 , 
rfs r s 2 


and compute successive vectors using the mean iteration formula 
(see [8]) 

C k+1 = k+T C k + FT H ( V * k = °» 1 ’ 2 ’ * ‘ * ' 

The number of iterations is specified by the internal parameter ITER 
(25 is a reasonable value). Upon completion of the iterations, the 
final C u , say C , is used to compute an initial vector B from 

K 0 

the formula 


B = CA . 
0 


3.3 Optimization Algorithm 

The numerical minimization algorithm used to find a local minimum 
of g is SUBROUTINE DFMFP from the IBM Scientific Subroutine Package 
[10], The procedure is based on the method of Fletcher and Powell [2]. 
Computation of the minimizing B is controlled by SUBROUTINE BVECT 
which initializes the following parameters used by DFMFP: 
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EST , . . . : An estimate of the minimum value of g(B). 

EPS . . . . : Tolerance for the expected absolute error 
of the optimization algorithm. Experience 
has shown 10" 4 to be a reasonable value. 

LIMIT . . . : Maximum number of iterations for the 

optimization algorithm. 

Values for the parameters are computed using empirically determined 
formulae. On return from SUBROUTINE DFMFP, the error parameter IER is 
checked and a message is printed if convergence is not achieved in 
LIMIT iteration, if the gradient calculations are in error, or if no 
minimum is found. Calculation of g(B) and is discussed 
below. 

3.4 Computation of g(B) and ||- 

The computation of g(B) and using the expressions given in 
Section 2.0 is performed in SUBROUTINE FUNCT. The function subprogram 
DPHIX computes 

4>(a, y,cr 2 ) = l + i ERF(^-IL) 

2 2 v ^ 2 

used in the computation of g(B) , where ERF is a library function 
subprogram given by 

ERF(a) = 2 ( 2tt) “ 2 J exp j- j t 2 J dt . 

o 

The transformed density functions p. (y,B) , 1 < i < L are evaluated 
in the function subprogram XNDF. The function subprogram FUNVAL 
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computes 

k i 

h, = l 2L- p (y,B) , 1 < i < m . 

1 j=k i l +l Y i J " ' 

In order to evaluate g(B) and ||- , it is necessary to determine 
the regions R. (B) , 1 < i < m , defined in Section 2.0. 

To determine the regions R^B) , 1 < i < m , the roots, 

y..(B) , of the equations 
^ J 

F . j (B) = B. h i - B. hj = 0 , i ? j , i , j = l,2,...,m 

are determined. If m. = m . = 1 (i .e. h. and h. each consist of 

’ J J 

a single normal cl ass), then the roots of F..(B) are determined in 

1 J 

SUBROUTINE R00TSS by evaluating the quadratic equation 
F ij< B) ■ + + v u< b > • 

where 

n ij( B ) * - BZ k bT 

' \J 

= (B^ B T )BP k - (BZ k _B T )By k _ 
and 

v (B) = (B2 k B T )(By k ) - (BZ. B T )(By ) 

1J K i K j K j K i 


+ (BE. B T ) (BE. B T )ln 
K i K j 


^, 2 be. b 1 
1 J 


6. 2 BE. B T 
J K i 
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For the case where n--(B) = 0, a single root 

■ J 

(Bu k ) 2 -(Bp k ) 2 +2(ln gi)(BE k B T ) 

y (B) i 1 1 1 

2(Bu k . Bu ) 

K j K 1 


is obtained. 

When either m^. f 1 or nij f 1 , the roots of the equation 
F. .(B) = 0 are determined using Newton's method in SUBROUTINE R00TSM. 

* vJ 

A maximum of 2(m.+m.) roots are searched for in the interval 

(x ,x ) , where 

1 2 

x = min <f By. - 3ot, (Be. B T ) 1 } 

1 k e K { k k k ’ 

x = max (By. + 3a. (By. B T )^ 2 / 

2 keK 1 k k k 

with 

K — | k . _i +1 . . ,k.. j u j kj +1 , . . . , k^ 

The starting values 

X o = Bp k + ( \ 
and 

x 0 = Bp k " ( F BE k BT ^ B 

are needed for each component class, k , in each of the two convex 
combinations considered. Updating of the argument, x , the function 
value, y , and the derivative, d , are continued until one of the 
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following conditions is met: 

(a) |y | < 10" 4 . 

(h) |d| < . 

2 1 

(c) The number of iterations of Newton's method exceeds 10 . 

(d) x i (x , x ) . 

1 2 

Only when condition (a) is met is a root, y - ^ (B ) , of F. .(B) = 0 

I J 1 J 

def i ned . 

After 2(m.+m.) starting values are used, the roots thus determined 

are arranged in ascending order. Roots having approximately equal values 
are combined into a single root. 

Once the roots, y . .(B) , of all the equations F..(B) = 0 have 

1 J * J 

been found, the regions R..(B) ,1 < i < m , are determined by the 

following ordering defined on a (possibly proper) subset of the roots: 

(a) Choose i , such that 


6 i 


k i 


i k-k, -i + l 


a. 


P k (y f , - B ) - » l 77 p k^' 2 1i lB) ' 

- J - k=kj -j+1 3 


2 1 


where 


i i 

2 1 


min 

l<j<m 

1 <r<m 


[y jr (B)-B Ei B T ] 
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considering only the subset of roots at which at least one of the convex 
combinations of densities has a value other than machine zero. 

(b) Choose i such that 

2 


k i 2 


a, 


B i l 


2 _-| + l Y ^2 

2 


p k (y .b) 

k n 


max B • I 
l<j<m J k=k 


j-1 


+1 Y i 


p k (y *b) 


where 


y 

o 


min 

l<j<m 




> y 


t 

i 2 i i ) 


1 <r<m 


(c) Let 


y = min / y.. | y.. > y. . I 

7 3 7 2 i < j <m ' J 7 2 ^2 i2ii / 


(d) In general, choose i q such that 


r. q “k 

b. y - 

\ k=k Y 

q Vv tl 


k. 

a k a k 

— P k (y >B) = max B, l — P k (y , 
Y i q k o 1 <j<m J k=kj_i+l Y j k o 


B) 


where 


y = min \ y. | y. > y. . I 
0 1 <j<m ' J J q q-1 f 


l<r<m 


if ly- I y- > y. ,• 1 = 0, let 

rjr I Y jr J i q 1 q _i ; 
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y = 

0 


iVi 


BS B' 
1 


(e) Choose 




min | y . . I y.. > y . . i 

J, q Yq-l f 


if 


J 


'ii I y-ji > y,- i } t 0 • 

J1 q J1 q Vq-V 


When the above set is empty the procedure is terminated. The regions 
R.(B) are given for 1 < j < m , by 

J ” 


MB) = U { y I y < y < y, 1 \ 

0 I, 1 Yq-k " ’q+l’q 1 


where 



The above procedure for determining the regions may detect 
unnecessary roots and assign the intervals to the left and right of 
such a root to the same region R^B) . The lack of machine precision 
may prohibit the evaluation of densities sufficiently accurate so 
that the same combination is defined to dominate at +°° and -°° . 

For both the initial B vector and the final normalized B 
vector, SUBROUTINE FUNCT outputs R j (B) , Bz.B 1 , Bp. , g(B) , 

||- , and B . In ouputting the transformed means and covariances, the 

classes are numbered in the order entered under the COMB command. For 
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the final normalized B, the entries q . . of the confusion matrix 

* J 

are computed using the formulas 

q i j = / hj(y,B)dy 
^•(B) 

and output. 

The parameter IOUT is an internal output control flag provided 
to SUBROUTINE FUNCT. 

IOUT . . . . : Control flag 

= -1 first pass (B ) printed. 

o 

= 0 intermediate iterations of DFMFP printed. 

= 1 last pass (final B) printed. 
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4.0 OPERATING PROCEDURE 

In order to simulate object time dimensioning, the user must 
provide a calling routine of the following form: 

DIMENSION ALRGE(IDIM) 

DOUBLE PRECISION BLRGE( IDIM2) 

COMMON MX, NX 
MX = 

NX = 

CALL PRDIM(ALRGE ,BLRGE) 

STOP 

END 

The values of MX, NX, IDIM and IDIM2 are determined as 
follows: 

MX = maximum value of MTOT for the program run. 

NX = maximum value of NFPC for the program run. 

IDIM = MX(23+4MX+NX(^-)+NX(|nX+|)+12 

IDIM2 = MX(7+3MX+^p +3NX+2NX 2 )+NX(~ + ^-)+7 

If available storage is not a problem, the user can incorporate 
maximum fixed dimensions into the program. 

The program is suitable for interactive operation with the 
inclusion of parameter request messages. The program was written 
in IBM Fortran G with development on the Texas A&M University 


IBM 360-65. 
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Input parameters are of a fixed format and must be in a specified 
order. Shown below are the variable names as described in Sections 
3.1 - 3.4 and the card formats for the command code sequences. 

Statistics Definition: 

"STATMO.NFPC 

class names (one per card) [F0RMAT(3A4)l 
mean vectors [FORMAT ( 5X , 5D1 5.8) ] 

covariance matrices [F0RMAT(5X,5D1 5.8) ] 

Feature Definition: 

"FEAT" ,N [FORMAT (A4, 12) ] 

IFEA [FORMAT ( 24 ( 1 2 , 1 X) ) ] 

Several cards may be used to define IFEA if N > 24. 

Combination Definition: 

"COMB" ,MC [FORMAT (A4, 12)] 

KCLS(1)-APR0B(1), KCLS ( M^ ) - APROB ( M.. ) , 99-BETA( 1 ) 

[F0RMAT( 7(12,1 X,F7.6,1 X) ,2X,A1 ) ] 

Each card defines the component class numbers (from the current 
statistics deck) along with associated a priori probabilities for each 
convex combination. 

After all classes of a combination are defined, 99 is entered as 
a class number followed by the a priori probability for the combination. 
If the a priori probability for the combination is to be the sum of the 
a prioris of its component classes, the class number 99 and associated 


a priori value can be omitted. If more than seven classes compose a 
combination, a slash (/) in column 80 of the current card indicates 
continued definition of the combination on succeeding cards. 

Feature Selection: 

"FSELMZ E FORMAT ( A4 , 1 Z ) ] 

BVECT* [F0RMAT(5X,5D1 5.8) 1 

*BVECT is entered only if IZ = 1. 
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5.0 EXAMPLE INPUT AND OUTPUT 


Example 1 . 

A 5 class, 12 dimensional statistics deck from MSS measurements 
of Hill County, Montana, is entered. A subset of 8 features (5-12) 
is considered. Combination 1 is defined as class 1 and combination 2 
is the combination of classes 2-5. Feature selection is performed. 

Col. 1 

STAT0512 

WHEAT 

FALLOW 

BARLEY 

GRASS 

STUBBLE 

statistics deck 
FEAT08 

05,06,07,08,09,10,11 ,12 
C0MB02 

01 - .347000, 99-. 5 

02- . 243000,03-. 121000,04-. 056000,05-. 233000, 99-: 5 
FSEL 


Example 2 . 

A 6 class, 12 dimensional statistics deck from MSS measurements of 
Hill County, Montana, is entered. Each class is defined as a separate 
combination. Feature selection is performed. Next, combinations of 
classes 4 and 5, 1, and 2, 3, and 6 are defined and feature selection 
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performed. 

Col. 1 

STAT061 2 
BARLEY 
STUBBLE 
GRASS 

WINTER WHEAT 
SPRING WHEAT 
FALLOW 

statistics deck 
COMB 06 

01 -.166666 

02- . 166666 

03- . 166666 

04- . 166666 

05- . 166666 

06- . 166666 
FSEL 
C0MB03 

04- . 1 66666 , 05- . 1 66666 , 99- . 333333 

01- . 166666, 99-. 333333 

02- . 1 66666 , 03- . 1 66666 , 06- . 1 66666 , 99- . 333333 


FSEL 



COVARIANCE MATRIX FOR WHEAT 



N . 


o 


. 04 

o 

00 



CM 

- 

© 

\© 

J': 

P) 

m 

N 


CVJ 

p- 

-e 

© 

r \n 

O 

• " P* 

:N 

o 

,'' yr 

<* 

O 

vO 

«v 

IX) 

n 


O 

CVl 

O 

CM-. 

••<r •: 



• 


* 

• 

• 

• 

• 


• 

• 

• 

• 

> . ; • 


o 

mi 

mi 


04 

m 

lit 

.w 


CM 

CM 

; m* 

Ol 



If! 


o 

cc 

m 

© 

p- 

O' 

o 


'■ OJ>- -• 

^4 

O' ’ 

O' 


o 

© 

vn 

aj 

© 


N ~ 


<T - 

O 

a 

rrj 

N 


O' 


© 

© 

O' 

m • 

-•© 

in 

n 

<& 

<5f 

w 


• 

• 

• 

• 

• 

• • 


• : 

• 

• 

• 

• h 

tvi ; 



'r-4 

o 

N 

r^> 

;(t) 

in 

o 

p> 

O 

o 

.*> 




^-4 ■ 

•"H 


.:’»: 


mi 


'■'j 

ro 



* 





n« , 

•t 





) .v 












V’’ 


’ ' - 






"T 



•* t- 

/ 4 «; 


u « v 

CM, 

n V 

o 

O' 

n v. 

p* 

CM 

N ■ 

-• O •:.>• 

O' ' ; ; 

■C:-. 

■ -i 

- 

«?■: 

U> 

© . 

a 

in 

© 

CM 

•o' 

- n : ■' 

N V 

© 

■mi 

mi V ^ 


o 

o 

CVJ 

CJO , 

© . 

UJ 

.:© . 


«* ;■ 

©: 

m 

« 

• ‘ 

• 

• 

• 

• 

• 

• 

C> 

• 

♦ 

• ■ 

.» 

• 

•"4 

evj 

CM 

mi 

p* 

u 

CV 


<f ■■ 

IV •>• 

CM- . 

6 

rrj 






r4 


;vj; 


3 


*. ) 

, n 4 








\* 


<■ . 


> .; 





’*■ ■ 




• c? 


; »<t v 

.=1 • 

i» lA . 


OKI 

a; cm 

U'U> 

(V in 

rp ’O' 

in V 

<f m 

•m n 

■ ©© 

© O' 

© VP 

to® 

© 


OU CM 

©w 

O u' 

V' — * 

VJU P» 

cvj r» 

«CVJ 

• in r* 

a; cm 

©O' 

id ©• 

\y cm : «•. 

-4 Vtf 

© <T 

cur> 

in o 

CM PJ 

IX) <T 

(M <T 

■r* cm 

a.)® 

<t «)- 


Q IT) 

W' CM / 

• • 

• • ■- 

• ♦ 

• • 

• • 

• • 

• f 

• 

• • 

• • •■ 

•• • 

r-'# • 

• • - 

n%i> 

in o 

in o 

m <-> 

— o 

— o 

*-4 mi 

o ^ 

CV! O 

<r cm 


O CV 

© N 

i 

i 

i 






f 

i . 



CV CM 


■ ncv 

^4 ^ 

mj in 

a © 

O <J 

n o' 

O xc 

N © 

: o rw 

ro ® 

■ ©© 

© © 


cn r.T 

r)'© 

P* 

m fs* 

'C •£ 

■ © © 

VU O 

N N 


■ . n rTi 

© o 

N;.n 

-,«VI o' 


fS cr-> ■ 

no 

o n . 

sr cr 

a; m 

o © 

N -4 

© CM 

■ O «-4' • 

CVl ® 

<r o 

CP.sO 

n ca 


I'"- 

. 'V - 

CM CM 

m 

© — 

Ovi OJ 

mi m 

. « CM 

6 -< 

‘ © A! 

cr' <t 

- 1 © 

o 


© CM . 


mi 

•-R 





T 




i 


© UJ. ■ 











Y : 

' l' 












• 

'd 

i‘4 

< 

• 4 








Jv. 




' , s 

IL’ 

* . 

©,w 

ON- 


w a> 

fn Q\ 

© 

©CM 

,® *r 

OJ so 

N P* 

■ N CO 

‘CM O' - 

X 

CM P-V 

©rrj 

<t N • 

' N CO 

© aj- 

U1 N 

CO o 

n c 

u» 

o ro 

N ©' 

. o o 

OJ CM . 

5 

— N 

'I *^ u> 

UU CM 

v-» -cr 

© -St 

w <y 

O' nj 

O 

rn i- 

r- o 

CM N- 

pi Cj 

<r im 


CM ^ 

•;? «c» 

’ • • 

• • 

♦ • 

• • 

• • 

• • 

» • 

• • 

• • 

• • 

• # • 

cr 

• 

; N© 

<t O' 

CM ® 

© -f 

CM |v 

o 

^ CM 


in 

cr «h 

CV! ^ 

<9 ™ 

c 

CU su-’ 

* ! ' »-N- 

rij 1 

wii 






i 

m* 

CM 


.1 1 

u. 

© n ■;. 

j -V 












u 

O 

' • 








* 







: 4** 

.<0 CM 

no 

rti © 

CM O 

O CM 

N Cj 

© n 

n in 

CM ©’ 

CM N 

;.w © 

u 

© ©. 

. <r Ki 

cu o 

n © 

.« © 

CON 

O <J 

^0 \C 

® o 

CM O' 

n n ‘ 

© n 

PO N 

© 

m* P» 

; -n 

•-* N 

n cv 

4* a> 


— © 

O'. (V 

p* N 

n »- 

© o 

O © 


> 

fTi 

; ©ro 

N © 

© UJ 

n cm 

-* ■C 

CVJ© 

O «KN 

oo 

n n 

© — 

— • CM 

p o 
1 

z 

® N 

i 







1 1 




< 

UJ 

*t n . 


«J3 




$ 




k 


■,-t 

•# 


.'■4 






i~ t 




jV'?: 


1 \ v!^ 


£*' : 
V<;W 




M- 


& 


t 


■vo;?i 

' 

a . 

o 

co yy 


' ; \0 . 

<M 

a 

•* 

in 

ro 


Ptfe-; 

u? 


CM 

r* 

O' 

c u 

f© 


N 

• 

w 

o 

■u)!% 

OJ 


tit 

^ -A* 

O' 

' ,vO - 

00 



N 

CD 

00 


♦ 

• 

,v*' 


* 

• • 

• 

• . 

♦ 

• 

• 

• 

> : 

(M 

- ; y' cm 

** 

^ .. .. 


CM • 

«S' 

-, < 
C-,v> 


T^t 


o 

o 


;■« 

•• <rl, 

m 

cm 

U) 


CD 

fs. 

« 

■St 

r- 

U) 

% 

0* 

> 

0*5 


* rj • 

>0 

D » 

U) 


<w 

CM 

<t 

C\J 

o 

tn 

: „ 

<o*r - : 

«3 


o 

o- 

0* 

' CM 

)0 

If) 

CVJ 


a 

^ 



■ -f 

• 

• 

• 

• 

• 

:• 

• 

t 

• 

't 

• 


. iMiC 

■» 

U) 

P) 

•M 

<r 

SU 

CM 

• 0~* 

CM 

CM 

O 

ri 

; r 

-i 




„ 










:'•’ Nf^ 


.-V * 

• • O'. ■ 

:vo ; 

S.'.: 

vcm 

« 

CO 

;<? If.'. <M 

n 

vinf 

in 


VU 

* vO^L’;! 

OM 

J ■ ‘ 

o -• 

vo 

ft 

r in 4 

m vio.-. 

N 

- '. cm ; j 

H .- 


Pl 

NSf 

m 


O 

CM 

n 

• O'. ' 

*P> .v s *v (T , k* 

CD 

P* 

p» - 



'<r 


it* ■ 
•p. ' 

• ' -A- 

• 

CO r 

• • 

<• C 

♦,.. . 

** c 

Jvl 

• 

*■4 

.- • 

k tM r. 

.P ^ ’ 


n> 










'■.1 ir 


<r. «1 


■. 

} ’ ■> j 


.‘«0 

■ 


r*- c- •*<• , 


• ■ 

; * i ' *. 

C v - ; 


■■•:• S‘ 

* 


:. v <5 

: 



s'J i": 



27Jy| ’■ v 


•v- 

:?• 


u, ■, 


•y; 


• * 

VS') •,«• -v, 

•# '.J -■ / 



^ •• 


.. tG 

ty*o'p 

■ : s 

^•: .•■ 
‘ • cm: i> 

■\a 

’.(M ■• 


« 

. 

. 

icm n 

in 

’’"SO' : 

:® . 

: ■_■> 

® | 

■ : : <o v®' 

p» 

■ : o 

,<r 


*0 

■ m 

P* >0 

VO 

OO t 


* , 

P) *' 

' tn?rt 

*0 

o 

-<6 - 

•—< 

CM 


6 *. " O' : 

vo 

" • 1 

•p) ■ 

& ’ 



■ • 

- . 


• - 


• . 

M ■. ♦ 

• 

• 



« 1 ••' 

• ‘ih 

CM 

;-v.n ! 

•f .., 

^ . 

}.s 


ro 

fr*. ,i K>:f 

’’i| : i 


\ ^ 

o 


& 

rn •■•‘V 

rv ; .,3> 

ih- 


* /* 

‘4. 




1 SH ' i 






■■■ ,. 

'.S 

Ar 

fl’ 




•• ?> 
j 

•;f; ••>■ > 


* ^ 




1 o§ 

4SS 


o' . ,-. c"tn 

> 00 O' • 

CM 'CD 

vO U! 

•; U) O' 

:6 pi 5 vo w 

a fV 

in cm 

o* m 


O vC 

P) SUMv O W 

CM vj 


w 

vo Q 

•CV| vv . a> P- 

OC vo 

p- r» 

V u 1 


f^> 

.4r vlLtn .0 

P^VJV 

vl; p; 

cj r* 


ll» vo ... Pi *’» 

CM -i 

»— « 

a rv 


vO- ;> 



• -'v 

-:'f • ; 

• 

• • 

• • 

'■•9 • • • 

• • 

• • 

• • 


• 

• ■ P)'r< 

»0 

U . OU fiii 

'13^ 

-- u 

n w 

P) o 

«*C - -< 

c\i o: 

r -\i m 

-4 rj 


O' 

. 1 
•'. vff.' 


» ■ ; ■> 





tv $- v|' 





^ f\J^- 


3P 

;S o: 

; _i' 
,v -l 

•»s < 


,l?r ’•*** 


®Sq. 


Wft, 

u>|5? 

H'oi 

$ 1 
t •) ■ MS 


oo try •op 
fM u > & to vo 

:4 •■> 


■»8 AlV: *0-W 
$* ?.£• — 
& fls i - ? 


i;.w 


’1 *•> 
$K; ; 

•& tr 


S < 



f«? S3 

II f 

’■ lit ' 


;4E •'.•,.* ■ t. 

W 'B : s 

4ss jjf 

V ?•' 

J 


to%j 

M ocM —Ves 


** ry'% 


,*>? — <f — 

flp rvij^ tf)>4 

'.Cj! CM' ; 

<■ 

cp VOr;;. 


U V — rv i;. C0.:vj3 

j© n# 

<\i n y. 


tf t r- :.;- tn PJ 

'iM {J'f'ns 

lt0*O;‘ 

it 

n <♦' 


• tt) 0*f>“ P- CM 

tv#.CM:?: vu:«g 

r) OJr': 

vo 

,^P». ( ;s CM CD 

O) g\T-Ur«l 

O'— : 

. < 

at oJV 

•3S 

? .• *44 

»f; .%• 

> 

• • 

itsff • • 


• 


" # 


• fc> n 

: >0 CM ' CM *4 


CVJ 

CVJ — U) 

•-» (VJ cu 

CJO ' 

a 

r4 «■•:; 



:••!•.' 


{ 

K '■ 

(H>’t 


it 

<t 4 4-i 


T > ' ; 

•^.T; .* ' r £ : 



i*iy ’ i • 

»i- ^ 

' 

.si 



. ID 


. v 

:: ■ z ’ 

". Ov^» 

in 

iP)N 

^4 

,0® 

»S CM 

. < 

CPA) 

in u>i-> 

n,<t 

•Oh CP ! 

vO;V0 

MJ O 

— 

•^.pv 

pn w 

u>:«i 


ml© 

N (7 

or * 

; •- « 

>■• •’*■ 

• :* 


•is • 

• • 

< 

> 

in — . 

vO «-i 

frj W.'.; 

-b 

A) O 


<t<r 

, O' w 

*V If) 

Nw 


:»J'; • ^ 93 
.IQO’r'fWtrt 

:«) — •: cr trj 

Si •:'■> • * 
& — • ,,o vn 


■ > j 

a 


iiwr ;t ;• 


• t'2' 


iS.’ 

*-< 

la: 

i# 

tf; 

v; 1 ' 


« —S4 o \0 
fn r»i-,r: s. 
V ODfVv p O 

♦ •;?'■ • • 
.*» in.<.' W P) 


■~i 0 4 
•V>N 

4» n;.:. 


a 

;>» 

;W 


an 

>> 


z 


a> o- 
(V p\; 
<r vo ; 

* •*’ 

pi o: 


<f oK.f 


••r 


I 


y 

$ 


l‘! 

>4 


1 


M 


ITS 

4 


a 

■1 


r..> 
; •$ 


'7- 

v «sr . v - • • 4s 

),», 

^ U>v (VJ-O) 

Q\ in 

? CM tt> 

M -A 

N vO 

(? N v 

: CM v0 

■incvi 


0 ) 0 *" 

: -t 

•b r» s o» 

**? ^ 

rn;W 

'.icf: —■'•■; O fv 

^ ^.0 

r) to 

q ro : ‘ 


AJ O’ 


■-b. r*%-- O 49 

A n. 


.MD'Vi-icM'O 

•cvj on 

'C — 

• O ~ r ' ; 


vpa ■ 

» 

: :ti> •• ' .•;• 

-f •■ 

• 6% 

' •.# • • 

• • ’ 

■ • ■# 

■If • . 


• • ;* 

j 

aj cm>: n — 

Tn /- 

If) CV: 

in cvj 

'W — ffi; — p? 

rn 

: CM. O 

H m 


■it ph : 



' 



'««4 



ft <tj. ■■ • 

. ’,4 




v?« 

• ; i* 

* 

• V •• 

✓ » ■,". 

3B 

: , i’" ■ ' 

/c? 

>V- 'T' . *’ 


. ■ t 

J# -j* 

X 


; Vjt 

S3 


y.: • 




c 




£3 


II 




EXAMPLE 1: SAMPLE OUTPUT 



AR1 AN.CE MAT 










ll©.p 


« 











i? 







ty 

v/( 




v . 




■•'s: 

.5 j/_ 



•?rt 

1 


.. | 

: : V 


fi- 

'•s 




1 * •' 

>t 

1*' 

• '*■ ; 

1 ' 
J? . . 


¥ 

v 

P 






■■"% 




;V' 


; / 





'77 











"4 

j y 






V-.- 

?Y% 





. J j* 




V . 



# V\ 







# 



•H 


■ *:k 







. '"j 






V- 1 

h 

- 

; 

%■ 










*x)s 



, 



/ « 









' v ' ’ 



1.'-/ 








*< 

jfj* 



.5..-, 

j'.;. 










■ ' 

; . 

•T ‘ 

' 'vj 

7 





• i.' 




r 








'•<iL •• ■ 

fi. 



















i 

it 








rj 




- X- 





•;- 

7 

i'7' 

.?■ 


















< i' ' 






o 

o 

-r** 

vO 


- V) 

iw 


N 


o 

N 


a? 


7y-, 



CV 

t— < 

•-« 


U> 

cr 

CV 



m 

cv 1 


;d 


« "■ 


»'& 



«Sr 

IT 

vo 

A 

u> 

N * 

; . VO . - 

ID 


u> 

cv 


ob 


<t 


■f X 



•* :/ 

• 

• 

. - • 

• 

• 

• ' 

5:# 

’<■ . 

• 

• 

• ■ . 

. • 


• ? • 





o 

•»* 




•"» 

n 

W 



cv 

cv 

o 

r 


; 










> 

;• 







CV 

;•. 

•v'i 

tC- 










v f;J 












, u 



c 




*>« 

A» 












^ ;• 

<* 

00 

cv 

. ^ v. 

in 

cu 

u? 


o 


tf) 

cv 


tn 





in v. 

r* 

00 

cv 

. n 

N 

»• (7 ' 

JS 


O' . 

o 


N 


in 


. 7 . 

» ... 


GU; 

< . 

^0 

oc 

cv 

VC 

n 



o'; 

in 

CO 

+* 


o 




i 

• 

• 

• - 


• 

• 





f 

• ■ 

■ 9 


• 





uf 

cv 

iv 

■m* 

VVI 

IV 




IV 

n 

IV 



<7 . 7 V 





:>;• 






=: ‘ 

,-r 

* 

















s**tj 


r. 




' 



’* . 



> "j" 







‘ vV 



. . • 








j* 








!*■< 


~ . 



v . 




.7 • 

* 



o 

in 

'6 

:V- 

N 

in . ' 

’4 


O' 

CV -X 

C7 V ; 



>r s 



;* 


Wr. 

vO . 

CV! 

N 

'i <t 

in 

N- 

a 


O'. , 

n 

s 

;V; 

r 

-CO ;: a 


ii 




*C ■ 

in 


.. m 

N 

v0 .. 

:-is- 


ID 

cn 

m* 

A0 


{ *+ 

/*>■ 




y; >: 

t 

0*4 

• 

■f 

\ cv 

• 

q 

• ■ - 

IV 

4.-* 

* 

• 

O 

• ■*;. 

•T* 

«!• 

[P 

• : ;t 

>2 & 
1 s* 

>«■* 

ji's 

>¥«■ 

p 






,= : 



t 

,\* 



C'. 


y > . ■ 



7 / 

|f 










. 





• . : y 

«* r * 


1 * 





IV 

in 

PD 

' N 


N. 

■,u 

« 


CO 

x 

O' ’ 

ffi 


-J »A 

* M 


¥ 5 



rj 

rr 

•*4 


cv 



O' 



vO 

Oi- 



A •"» 

4 

iK? 




<v 

P) 

CV 

' 5 N 

m 

. cv . 

u> 


« , 

•<» 

VJ . 

n 

r 

O' : -'i? 


"■ y. 



•-• 

• 

9 


•' . 

• 

• 

:'9 


♦ i' 

• 

• V 

• • 




J*! 



CJ . 

— 


' .f"* 

cv 

cv 

. cv. 


i 7 < - 

U 

**• 

9-4 

,6 


O' f4 

n v. 


>* ' 
V '• 

Wp 

a ■. 



V 















* 

*V i 



r\j>— 

fs. 

^ f 

•qr on 

rr> ST 

CP 

cv.cv 

4 i* Ni 

n“w 

<r 

cn <r 

X Vi 


r? in^ ■ 





o o 

>0 O' 

<r 

*-* 

VU 

N NL- 

CVfi 

U? ^ • 

VO CV 

vy , 

n u; 

ui 


q 





aj cv 

« o 

OU CV 

. C p »-♦ 

(V V) 

q SU 

Q)+* 


n <v 

O UJ 

M) o 

f > 







•'! • 

• • 

• • 

:• • 

• • 

• • 

• • 

• 

•; ' 

• • 

• •: "• 

• 

• • 


• • - 

*•* 




OQ 

— o 

— o 

■*- O 

— o 

— * c» 

*-4 ** 

O 

o.r" 

«-4 w-H . 

o m 

O CM 


ct» cv 





.1 

1 






•>v 







w cv; * • 

» 




> ■ 






'. *: 

• y 







%■: 











‘ < 








,'T * 

■ > 

t i 










?• J'v 




*• 



UK' 


7 V 


u». ■; 

^ ' • 











k'.- 

, ; 


?Vo 


7 

_ .f’ 


vO’fi- 

O' O' 

N"** 

<f cn 

* i no 

in cr- 

otjtn 

9 0,; i 

O' ID 

(V CP ; f 

• i@0 

: <t ; - 





j 

cn 

"tiPP 

S !*■) •• 

<\!<C 

«n 

c 

CV s 

' . 00 OP 


■n.ir. 

M) iX> : 


^ in 


^ jf 

. ?, t 



C 2 : . 

4(.<V 

IT <* 

in 

cc\p 

rn-C 

Mi ") 

<0t p 

■:ac 


<f tv 

\c cm.; 

•-4.ps . 

N o. 


^ N-7! 

; 7 

y- ; 

■* 

TV.-. 


,• • . 

• 

'/ • • 

• . f 

• • 

• • 

• • 

• ' / 

• • 

• <■ 


4 • 


• •'*' 

7 j. 

M 7 

j ■ 

H- 

; -!-f 

w o 

rn ^ 

r- o 



oinj 

‘m? 

IV 4 

o ro 

;«-♦ <r, 

1 ’'.cb 

6 rn- .•• 


1 n 7 

f, 

jij- • 

S •;. 

X’ 

vjv 

cv 
u. t. 

>. $ 

!; & 
: . !i.Ej 

?iw 

■•; -J 


$ 




.i'jt 

* h • 

;?;•> 

1 

'./■i 


^ ,;.V" 

\'v 

j£':4 

.*'• ; ; 4 

"/A 

.>v ‘’’i 

UJ 

J 

,x 

■CO 

•s 

4 <!■■{.., 

■ i *1 

V* 'Vfc 



* ■ *■ 

f# • 1 

i V 

: a ' in 

■rsf nv' 

uvcv 

if* -9 

4 . >o cr 

p <v 

: .. <r'*$ 

O 

o> 

'O.'O 

:-l^ vO;?. 

Ov# 

^ vD 

K 

— Oj’fJ 


y] 


X •• 

’5® 

■N 'O.i . 1 

N \0 

'O o 

n’i< 

vb rv 

r>* O 

.*4 wry 

(J- r* 

He 


# O' 

,cn 



V-J< 



N c\l : 

U) <o 

-*S£- O 


p a? 

<r if j 

w'.'i 

tM-n 

CV VJ . 

<?<v 

Sp CO. 

r 



V7g 


or .-. 1 


• • ’■ 

• t 

• v4? * 

ii 

• • 

• « 


•-y, 

• » 

• *■:' 


7# • 

a 

■ . • ; 





—•6 

4 — 

0 J 

«B» rW 


**•< fH 

cv^ro 

C).' 

U_TO 

vo 


: P 

a 

r» ' 0 :i 


rj 


< 

■ ¥* 











I 

x 

<j 4 

*7 


.jJt 

2 ■ 





y 








■, * , . 



j-/ 

.1 







■J 






•\ ■ 

y / 

7 , 

cx 



1 1 


LU 

v ! ; ;' 









..... 



7 

o 





U 

z 

:,'7 

05 vO-vi. 

sua 

•J' 

% n 

v: IS CD 

— O' 

O'O 



—.00 

ID JJ . 

n in 

4 ^(V ' 

■hr 

O 

nri fTvi 










< 

chi* 

O O' 


<7 'C 

n« 

C\< O' 

. i.o<r 

<v ro; 

^,N 

O — i- 

a? in 

?C7CV - 

UJ 

cb 

! 

> 

* 

— 

. SSyjt. 

•vC CJ 

<T <t 

P 0 ; 


'O LT 

x*o 

■c m- . 

— N 

C I’l 

(V X 

-CV VO; 

> 

<c 

- 



/v 

• 

• • 

• • 

v.',* •" 


• • 

• .• 


• 

•’ • 

• •• "' 

• • 

•' 


9 9'rr. 



v-V 

< . 

O 

— o 


; o o 

O'O 

o o 

o CV 

. C -« 

o.ro 

O w. 

om 

b 

z 

to w;-.i 


fV 


> 

'■ ;■>». 




: ^ 





l 

1 V.' 

i . 

Yf 

< 

4 4:' : 




Q * 

’! -V: 



0 . 

l • 



: \* 





*i '- ' 




?vT 




i;. 






ig: 



— 

-* 

.. . . 

— • 

■ 


7cj 




EXAMPLE 1: SAMPLE OUTPUT 






















m 


«A8»- 
7 $h 
u 'm 


<■ .. 

Up 

Uip 


5 |i 

zv& 


UJ-*’.- 
u .: 
z : ' 


IS.. 


‘if 


N 

8 


it 


•Vi 

■1 






iv>y 


a 

f 

■9, 


an 

‘•;-i 

:n 

Z 


if;* 


1 

tn 

s 

hi* 

'yt 

v; 


aj m.gjavco 

V- w Si» s- ; i* 

(V! (MtVI — — 

a crqc o- a 


nrcvioj — 

b oo o n 

•/O C.C3 oo 
Al cr> «w o.p 
,w to'w — b 
to u> ft- <ro 

« (Vf «< >£> O 

O' 5 o> ^ o 
<0 ** *9 
'. 5 i i*Hfg n.p 

** -v«* 
> »V* 

: p o|o o-o 

V v 'w V-!$ 

> Vt*t vs* 

V V V V V 

— — w rvi W 

n o o o o 


I 

fe 


8 


fes' 

M.s. 


§ 


{•i 
‘t - 


• X ; 
■ » rv ■’ 


N ;. 

c> 


n 


jK, 

fiv; ; 

ii 

££>• 


■M' 

'At 


m 
$ 

*> r M 

hi m 


. 4y i 


;.V 






ii 




■ft 


?z\ 


$ 


,t& ■, v -’ 

Vj.. 
•; >,» 4 

4 ;• 

’ 




' K 

jf| .4 V; ; 


0" 



•V 




;< • 





(J - 1 ■■'■ i~- 

rv- 

yi 

K*l< 

■r>.i 

B 


y •• t 

$$ r.i; l;- 

• ',t; y 

r j 
'VI 

Sj 


sss 

’„vl 

OaI* 

■A 

■ ?«5. 

y<- 

Py ■•••' VA 

'\TS ’’ ■$■£> 

: t;i 

•i | 

y I 




\& 

n 

? w 

.jV •■'. 

;Vi* *■.’ 

ijv, 

w 



■•A 

^T. K /,i • 

... % 


It; 

» 

jit 


'v •' ’■■‘ 4 ‘ .' 


T* 

it 


h 

y, A 

• " V’^ ,, 

1,’ . jif 




'v! 

} - J 

•VL- »» * •. 

.•)'. 6 


•pii ■ 


V',; 

"V 

sit; ' *y ‘ 

- ;lr| 


*Zi 

yg, 



1 

p V- 


i 

it 1 . 



• ”• . 

i,:- •'• V, 



..•'•■ 


' ■•; 


;f. '• ■ 

't'. 


■ y 





I * 

i t 

& 

i 1 




fcK 


m. 
m 
■& 

tow x» -ft -is-; 

X o o o-« o •?; 

«*-. gw 

o O.Q O'S O.:. 
uj vo;« op o £ 
X - TO r-'o (V :<. 
Or X TO aj «*» tr ; 
ONO *0! TO 
■u. m *t tr w — ':i 

WUO VO fj TO 
2 OTO r~ j») i\J 


iy v : *' . 

i .' 
».r% 


Ms- 

.si.? 


m 
m 

e*s 

m 

g ’ ^ 

K i;V- ^ 
§f •?;? fife 
IS * !1 

p 

II If 

J?*VV . ■•! 

0!< 9+ O ; > 

If o o 

SH i : t 

>,v QQ • 

in*.- 

}>• 

fe w 

J'i- TO X; 
r : iidi, , 

i>. o <vH. 

i:s * -r?f- 

2 *;»: • • > 

# ??>;■ 

H ll U 

jl ‘4 'jfit i 

fe w«fr 

.•jfj. 


II ® mw- 

S it- 


Q 

is 

in 


NO| 

x-W 

d'O'it 

AO IVilT) 

TO IT) V* 
«0 TO * 
O O' b 
<V-TO 


m 


oop 
o 0:9 

a au 
-lO'W 

to* in 

in '-'TO 


aow o.w p. • 

UV (Vj .*|£- 4 ; 

u. f’J yp o bi ov.'g- 
wS •* TO <0.(fi O-'S 
TO m b rvj«, 
< k « f- 'rn to?- ! 
a; • • •» *. • 


TO 

b) 

< 

J 

w 

in 


■ Z:.* ^ 

UJ 10 u/ * 

1 - % to o 
o 

<T • • 

cr 000 


UJ, 

b 

p <vl«a 0 D ( jO 
© M-tn cm# 

•" X ': 

o..r 

O' 

V 00 00 oir 


TO 

Ofr ■ 

O 



• . 


• ’ *:V 

X 

;« n h 

LI. 

u 

0 u ; &■ ^ v 


O vf 

u 


# ? 


u.'..,- 

Uj 


C TO TO — le 

U.'; 




1 ?? :■<;• 

‘U; 

**• ** 

> 

TO 

; .. TO O J.t 0>0> 

>—* 

0 -s 

0 


-v vr 

.O 

•4 * N 

2 V» 

K 

■ ■ ZP't<? <• * 

. TO- 

O , 

O V. 




‘ ”&<■ -.1 

U.; 

J 

.>00 TO;jT3 TO |TJ 


O'-.. 


TO 

— TO TO® TO. 


u->: 

3, 

** 10 •** 

'. li. " 

x- ; ; 

1 — « 

TO 

CQ 

KlflKX 


TO 

L 2 • •, • • * 

>".• Z-,. 

O';-'. 

0 

< 

it ,r 

a 

« 

. U#Ms 

O-. 

UJ 

UJO 0606 

0 

• - /* 

• 

J 

9f ;V 

UJfZZtZ 

Z.;:.. 

or, 

. a 1 

u : 

0 ; 

O 

0 

:: i 8 . •• 

n : 

- >I»tf 


ML’ LT f> 

^ .in o -e 
i;K (V cr .91 
"S TO 

> - • Irt TO * 

\:V H N io 
?, -* to to 

** <- 4 ;p 
-> •(-' 
A ;© o,b 

'c-<x '<i 1 V • 

; fvo ij 11. n 
,; : *■ ■ 

? f;>SOTO~~ 

UJ r* * N 

■J*sp®s 


,v 


I I- 

i r 


•V" •"»» 

#1 WP, 

' TO 


8 




l- 

v« 

— TO a><w 

aj 

TO 

OOO 

.*■ ;■* 

O X U) 

t 

.« ‘ 



jl- 

a 

• • 

• . 

TO 

.1.1 

•“i 

p it r-. 

s’* 5 

r<£ 

% 

••jj 


Vr • 

v 0 0 00. 0 

TO 

II. II II 


N- — (Vi 

• v - 

t c ■ 

• y. y 




': ' 


O 



uu ivi r) 

ip. 






'«pd. 


— 


p; 

— i'iP 

i e 

■} : - 



Vr 

•f- 

■t m 


.—>■ 

WTO TO 


• • » 

'pi; 








• 

’* j' *7 


OOO 



V .. 
C'f 


•p 

TO 

i 

%4 

it-5 

O 

1! 

X X/K 

•*>' H|» 

i| 

II ..... 

II II II 

V 

• ‘- 'Jr ■ 

' P < 

4?;. 

•p - 1 
■ 

■/•in 

'■■ 


to 

* 

4 # m 

i I 

rw ■ 

-CD 

SZ'2 

v c t> - ' 



** _ 

t 


W 

:Z 

74: 

y 

Ui to 10 


W TO TO 

-• V 

i'V: 

r- ( 

•pt. 


V; 

5 

,jw ;.>« 


z 

4 


-W w W 

•j.? 




■v' - - 

V* 

• - 

©i 

10 


J'a 

cp c vp 


» 




a 

jrXi 

ft 

■« 


V-’-U 

* '• f \ ■ 





‘:v 



: ■- : ' 

Kr 


; ?v 

V;.. 

, v ’ 



; .5» 

i-tv tlS 

Ml- 

^fe- 


to to in 



y'; 



, 


O 


u 

0 0 c 


. ‘1; ’ , 


iv*. 


s f ■ 

;»• <! 

•u 0900 04 » 


1 II 


' 


;a-v, 


/. ’• 




0 

O Cl 0 

- 4- 

0 0 b 




,iy. 


. c or© 00 

Die? 

:■© 

- - ’TO TO (V 

•\ ^ 

00 O 

.‘4 r ^#i 

T 

'Vy~, 

ty. 


It) TOO' — <j 

; U. r 

p» <r O 

■ < * 


’ fr 'p 

.■rj- 


m 


:x to to 'u-fS o:-- 



’• ;*> 
: .-■ >v 

d r.b 

• ! A? 

4 ; ;. 


‘ 5i 


5 i 

i:j 

it 


t -I 


ri 

--i 
^ * 

8 

v '3 

J vt . 

U 

ll 


3 - 

s> ■% ■'/ 

j'-fj •/ 


."Hi 




I ^ ' 

i v' •: 


-/A 


■k »i 

■ 4 Vi 


is y a 

S : f 


V I 

/• 


EXAMPLE 1 : SAMPLE OUTPUT 



1 O' <T? 


i\ir© o 


■WI5 « r.| 



QU <T 

■r m.l# 

# 'O' ;;; 

aiK 

<t <tj > 

<t Ct> 

::<0 t'l 


If) H> 

•' o * 


do; 

** >u t 

cues 

vu 

«V^ 

OJ LT 

■xi «■ 

:•§ <-> V 

fS. 

<t Ul 

vu ■3’ 

Jir r- 

• -♦ 

• • 

• • 

’ :# : 

« • 

• • 

• 

V# •. 

o p? 

vP n * 

■=f V 

■»<-* 

vo rr) 

CD '’I 

n < 

o tv 


<0*4 

• 'i 

:-;l; 'I' 








(* Vl 



-V| 

■■ 


mill 

<t vE 

o».d 

*fs- CO?,:,';. 

^r: 

M ^ ',•• 

in in 

& rr * 

o (V 

S) n 

rtie 

Its a .:‘ 

<r D 

rn in"- 


o 

13 

- c 

a»tvj 

•«i cm.4 

ON Q- 

rs. vL‘- ; 

mn 

V/ '■ 


■ n oi 


m.tv o' o 


mo 

N >1' 

<M « 

X «-i 

mit 

<M \0 

cO N 

(0 N 

o ; p- 

W cu 

1,’ <f 

rs O' 


<f 'V : r D.\* l • <£ i£» 

o ir, i\ac >«i 










cc v As! i a^ce. M.AJR14.. Fgn .stubble 


_ m ^ 


sp 


f-.'f . 


&& 




£ 






Hi-:. 


,136 


efc*'- 




j- ’-.a 

>]•• Si 


;## 

£vf. 

|p 


1 

$vi 

i«-A 

■t-*' 

\y 

- /f 


* r 

w 

ip 

':H • 
‘ 51- 

£v>. 

V : f 

■ ■ < 

• \ 

A ^ 

J *& :V. 

„w- 

jfe 

f $ 

€ 

B 

1 

7-W 

1 

- .V 

.*♦£ 

a 

Uv* 

• & 

li • ; 

tivc 

1 ■- 

* 

Jis 

> 

? • • 

fr 


'- 1 . t' 


| 



•Y'J 

i r< 

f VP» 



J ’* Kj* 

31 

: t 5 ;* 

i 

>, 

Viv! 

ij 

XSTt 

ifcp 

; ( >1 » 

.’■Vi- 

8 

m 

m 

Kr 

1, . 

h - . 

• •<%! 

•: ■■ 

■ 

0 

’ O, 

•HI 

\ 'C ; 1 . 

<r 

:.tn' ' 

Cl 

‘ S “i 

a 




,00 


K • 




• . CVJK 

®H 

• hH 


-t. IT ■ 

O' 

cv 

«e 

ro i'i- ■ 

tv 



i‘‘ 1 

$■(: 

« 


! » 

V:-: 



?■ 

UJ 

: . , to:’ 

'*f¥ 

u> . :- 

N 

to. 

in 

U ):■;:/ 

PJ 

.. wyj 

00 

:.yt • 


<r 

&t ‘s' 

fr 

|ic 


*"*y /'V ' 


*• 

■ .r 

• 

• ■ • 

• 

• 

it 


■ • 

•1&5 

iff 



...♦ 

irSiS 

Ifc 

5 ? : 

¥>.1 

i> 

• 

'/ 


v *“ l 

' J • •*•4 

yH 

•H . * ’ 

.V ’.‘* 

HH 

n . ; 

CSI 

jj, ; 


rv 


f 



.iU 

jtv 

* ■ 

i- ;■ 


!»• 


‘.ft ‘ . . ; 




Cs 


. 





; :* *v; v’. ’ 

.. •?; 



ife 

..ft 

f*? 

*• 


X ' ''wi ‘ 




-'Nr 


’i 

^ '/it 



• ?• :V 

>; fv.< 

>* • ••' fj 



'■'v 


if 






1 , •*'- 


1 *■ 




*«v • * 


^ ' 

vr; 

\ ■ 



; v v ,4 


o>fv 


. CC' 

(Si 


in 

CO ! 

ii? 

■Y 0 

* 

‘ f ; If)*;. 

CW >v ■*:* 

in 

Si 

(- 

>v 



;~ 

"V IT) 

oo‘ 

r* 

< 

■ \ X : 

.re . 

(Vi 

<c 

.• ; n- 

(\i 

r- 

-r w 
’•', ro ; ; 

:Ci) 

# 

•O' 

••.Vo 

0 

in 

v 0 »i ; * 

>;©r i; 

S' v- 

«> 

0 

>7 

' V- 

.Vr. > 


. • IV • 

t A 


• 

*• . 

,.i 


- • 

#•■ ' r 


♦ 1 


i' • 


* 


n;- ■ 



• " 


■ ^ : X' 

« • t.*'*’ 

w 

. (\i 

{** 

• W *'s. 

,C\J 

• I'- : . ! 

r> 

<■ v : > 

• y : tv 


cvji. 

‘mi j/‘ 

•4 

<T; 

Ti' * 

i 

; J/ 


V; 

\ 

* .'• * i-.--; . 


. ■ ; ■ * 


. . v 



• <■**. 



{ • fj 

\ / , i V ‘= 

' ' 

$vi 

J it.' 

S; ; 

jh : 

> ! 

l ‘s' 


:V- 


' 

i* 





r ' 


*» - 

'• ’* 1 





, /. " 

v.: Vi 



?P 


y\ 


f : V. 



0> O' . 


<t CO’"." 

in .0*. 

to c 

xin 

mo.Hrr<fi 

(\i cr 




0"0i.-. 

jy<! 

\K 

— to 

N ' r 

vp 

<f tr- •: 

^ 0 

CVJ N 

x on 

'**. w i:' : to to 

to x 


in > 




Y : \ 

«r c\j 

in <r 

u> ^ 

CU vT 

IVO 

u; m 

eu 

iQ -«.t. • CO 

to (V! 

-'O' 

W O- 


•f N 


• • 

• • 

• • 

• • - 

• • 

• • 

• « 

♦ • • • 

• • 

•;'i» 

• • ' 





t; —O 

« c..' 

rr;,^ 

•H O 

•— * — . 

•H v-h 

tv <M 

^ 04 On 

f* 

-.vO 

0 n*- : 


It N ’• j 

? v : 

* w 

• 1 









^ : x> 

, , » 

u4 

0! <t - . 


■r ;. : 

* • 










■J 


i-'v 

•V v 

?’ *’% 

* ■ - 







• r<? • 


K t \ % 

CO 

. ',;*■? -CtU 

U y.t! 


rVj 

5 : 

•list 






' •*> 

V c 

■ ' x-5 


03 

. <j £->V 

1; _ *. 


l # 

m ■ 

’ ^ (N 

r^. <rj 

VC <V 

u* rv 

<T O' 

i«| cr -f to 

^ to, 

.h:= 

'"O';® 

. jT'X: i • 

D 

(r> 

^ >1 
H Oft?, • 

% 

V-. j’t 

'^1 

’?■ 0.0 
■lOjii 

ife vf>*- 


O vo ;• 


var 

r- c 

cr -hi 

A0 *-H- 

;t: ® 


in 

^CVl* 

,.\ f 


•r* oj 



O' 

vw cr 

■tr If! 

%i (\JV • VV ,fS> 

■Cjj 0 

>* <r w 

O CC-'-'X 



fei 

• l - '0 


• . 


■;• • '■• 

• - p 

• • 

• • 

if • .• 

/ 4 •' 

•’ * 


a 

V« 

w. 

V* 

. ' >. 0 

.<r — 

Os.’ «•* 

»H| «"* ■• 


m* —> 

r\: m 

.♦A (M- : \ o n 

OH to 

o'« 

d 

•0 



pi' 

•,i 










1 

U. 

. # 


IV 

sis 











'•-• 


• A ; sN t' 


.'■"v 

/ 3i 







. : “ v , 


. ;. ' 

>v 

■O 

■••■• : "¥ 

I s ' 

p’ 





‘ 



,v N . • 



X'l -•? 

H- 

i 


p 


XO vf 

VO O’ 

: .W m ; - 

n <r 

« (J- 

•<?■ O 

N r* CO 

into 

• N IT 

^ CVJ : S 

0 

.© erffv 

‘/■I 

la 

; 0 S 

a & 

-'C 

OisO.'- 

n tt 

04 C 

mo> 

<y n‘i: N'f* 

6^' 

s xin 

•cr ojv-v 

UJ 

to 

\y, 

lit 

• ^ M 

vC CVJ 

<r 

CO p^ : * 

<T 

voir 

30 0 

# uj! # - 4 !lS : 

O n 

. w® 

■N to j:; 

> 

•to 


t; 

. •. » 

• • 

• • 

• • 

• • 

■ • •■ 

• * 

• •'• • > 

• • 

• ■ • 

* • t' 


* • 



■ — O 

HH O 

^ Q 

QO; 

O O 

0 0 

O 00 

0 0 n 

Q r> 

oir, 

O- 


ro pj-V 


* - * 

! 






* 

1 

1 

I * 

;! 

« 

M3 

.*■ 

;k> 

: v\ 

jif 

« 


it 




. ,VV 

"w < '; 

:0 ! ' 

U>-“ 

■p' *vV 

<r 


Uu> .. 

<r . 

'.-'O' ; 

pi 

;; 0^5 

; 

' !<t 

Yf 



‘ S; * ■ 


’ S'* 


.16 •" 

CVJ 

*K‘ i‘- 

<?■ •'• 

in 

^N r< - 

O' 

: 'o 

fft 


)0 

■•„ ?5 : 4i 

ii'sl 

fir 

• - * v »i* • ir‘" 


V * 


‘ •'« tor'Vl 

:.« 

If) 


n ; 

N 

ton ’ 

:fs? . 

:, m ■ 

® 

4? vn^\ 

>6 y. 

.‘ri M ’J 



*’ r- 


. * 

i; v ' ; 

. • 

9 » 

f J, 

' • 

• 


«.• '.- 

j • 

,* 

r!> •iyf 

.♦ 

'"• « % 

v g 

l '* 




5 

• /' 

1 V ' o‘ 't. 

•H 


:■ 

<\i' 7 ‘ 

<r 

VV 



’ »H 

»? - v ^ 

O v. 


|: 


; J J * ‘ 



.;j‘\ 



• j >■ 





■?• 


. . ! i t-.-. ■• 

'f . T 

». y % 

fvK 

■ •> 

f) 

.• % 

Hf. 

P i: • 

. T ! v •’ 

.1 A 

t? 



•;>: "1 

X ' 



" 

:P ;/v 

v. 

r. iv 

:?:■ >;t 


■i f • 

i* 

:)tf; 

••(■4 


;, 0 '^ ,r 
. : 

■;_»:• 

•v 7 


I 

: . s •;; 

to ; - 

U) 

n 

r* 


N 

to 

. X 

co. 

(T ! “ ' ■ 

O;. 

l -V 

1% -s 

*:t'V 

40 . 5 . 

Q. 

5 T 

v, ; 


ijjti 

r .; 

ft 


>0. 

(V . 


n 


•' <f : 

to 

,>>• 

-* I- 

>■» / 

■v ' '' 

-■ <>'!' 

00:. 

f 

•% 

■ <r..y 

M 

rn 

61 

N # - 

ro 

CVi 

tf) 

to' 

<t 

O'; 

# ;/ 

Aj :0V H 

•‘ ( v 

4 <i 



’ : fx 


• 

• 

' • 

• 

• 

• j 

3# 

• .. 

• 

' 

■?■* ?V, 



fX 



?■ ' 

py 

O • ; 

•H 



C\' . . 

(VI 

CM 


. 0 



6 ' 5 ' : 

fT 

:;? -3 | 

•;v : 

fi 

• • 
CM 


• * 

f 

hi 

: *'■ 







~ * 




W* 

wjt, • •' 


i?: 

UJ 


; ^ 

■ X 

’. % 











A:' 

f ?V: 

;C' 

|fl 

A—l .". 



:■ .<•!' 








' v^‘ 



• v . 

t ••■•.' 

'S *< 

.?i . 

PjR 

■ a.i . 



. ’ • 

cv‘'r» 

s v- . 

vr-'<j' 

<r ® .. 

r; <r 

O <t 

IV <v 

■m r- 

.'£ r n M 

<r 'f- 

■ j x <j- 

d u> ;w - 

;• ^i-orTi 

J; 

■S-.Y 

— <• 



V'« 

( 7 *Ch 

to O' 



V1»»H 

S- to 


U?ro 

. to cv 

to ir 

PJ u> 

•H a.! , 

c ^ A 


1" 

* 4 . 1 

X . 



' 

a>cy 

vlJ O 

a- OJ 

UJ r- 

vv» r) 

<r to 

to’ ^ 

•^ UJ 

. r 1 vO 

c> a:- 

tod 

•H to 

K to ■/ 



UJ ; 



1 

'»» 

• *■• 

• • 

• ♦ 

■.'• • } 

• • 

• • 

• • 

•# •' 

• • 

• • 

• ■ • 

‘ 9 • 

? • V.'i 


•V 





OO 

•;i. 

•H Q 

- O 

h o : *: 

— c 

-* 0 

•H'^y 

n 0 

O -* 

•H 

0 m 

O <VJ' 

q> (V : ' ;- 


It t 




'-t ! 

1 










•' 

CVi .■ ' 






6 ; 


•j? 

& 


it* 


•. ■: u> 

• !4 








































*8 #*’ i 

■&. Si 


if If f§ ¥ § 

"•> Jfe *| «■ 


• at ^ .v 


v|; 

^ V 


' ?■ - 

0 

(V 


: '43 

w 

O ^ 







f; ! 

;r.w 

UJ 

>♦ 

<Vi 

« 

<> 

• 

0 

O i 

rv 

: ..»• 




0 


j) v ; 

«v 

vL’ 

U! 

<r 

r% 

0 


•- 

n 

N 4 : 

$ 



op 


•; ■ 

• 

• 

• 

% 

• 

• 

• 

• 

* 

! • 

» 



* 




<\i 

44 



cv 

.44 

** 



p 



0 




P) 

T\, 

U) 

<♦ 

3 j 

;N 

0 


rw 

UK. 


O’ 

•V 



M) 

< 4 ) 

r»^ 

IP 

'<?■ 

<0 

rvj 


CVJ; 


10 


c 

•c 

■tf 

O 

. vt 

O' 

<\* 

sC 

IT! 

cv 

. . ’ . 

a 

fw 



# 

♦ 

<• 

• 

• 

• 

,* 

• 

• 

• 

* 

♦ 



<T 

ir> ■ 

Pi 

• *< 


t 'V 

CVl 

—* 

cv 

• V\J 

p 

Hi 

■d 1 



«*4 

a 

■0 


vC 

■ X 

-•4 

• a. . 

n 

4- in v 


« 


w 


0 

vC 

4t 

m 


: c 

N 

CM 1 ;v 


n 

N 

P5 

*-« . ’’ 

0 

c: 

n 

O' 

(? 

.■"O' 

X 

n4. 

N 

V? 


4 

* 


• 

• 

• 

• 

4- 

• 

• - 

. 

t 

cvi ; 


u> 

r») 

<T ", 



«•# 

:. . O ’ 


* CV .'• 

;p • 

*1 

sr 


c 


CV, 

Ci 

X 

B 

• 

<u - , r ••,-• 


B .’. 

P) 

O 

♦ 

cr 

B 

• ; r, • •• 

;-<■ m ;; 

B 

1/5 

« 

O . 

B 

*— • 

(M 


(<r •>• a 

B 

4 

4 

• 

« 

... •*•'. 

• 

• 

« 4 

4 

’ 

(V 

pr. 

- 

; V: 


• r. .-■ 

|§ ..VO . 

*~f 


if 


} 


A 

* 

> •- 

m ni 




, : >■■ 

0 I 

r* ?. T 

^ in . 

asc-j 
OJ 0 ;’ 

Kcj 

VD Ui 

■>■ in<r 

:.0t p> ;/ 

VO Q 

'C^.CVj in,CV 

C^' IP 1 

pbT 

O' U? 

u.- 

00 

<r •-* 

O 4- 

<’ *t? viJ 

■ft) (V 

X cS 

’CP vu r* f 3 

:©«'• " ; : 

tv — : 

uj>4 

<T U' 

in q 

m 0 

vi : 1 '} 

Or- 

0 CT« 

-ii) u-> :. 

rj n; 

(V ; 

0 r* 

B — . 

• ‘.f 

• • 

• . • 

4 4 

• • 

• • 

• • 

/'4 4l-‘"' 

• '• 

• • • • 

• • )■ 

4 4' 



j * r— 

tn — 

4-4,0 

r> cv 

nop 

>4 of- ' 


CV 0 . W ? 

4^ fTJ 

PO 





*• 



f 5\ r 


' V • 


r* cm 







; : 

..... 

' . .* 


£?• ‘'I, 




A' 


, r r 



••: 4 ..;■ 


♦ .c 


/.* - # 





3 

.• pr© 

■«i* in 

Bftl 

a U - CM 0 

O U 5 

cm in 


a N.f. 

rj-B 

in o' .• 

■ina 

,»p •< 

n 

; py-ifti 

Cp •--?■ 

■ Bfrt 

0 f" ■ 0 cn 

A cj 

P ! ft) 

(Sh ^ f*** 

vD — ' 

r’W 

,:Q 

ft! W 


< 

U'TfV, 

ts* Lf- 

.. '.0 B 

m-i. c - 

ri r> 


iC B 

CV) X • 

vL'rf 

.Q i.r i 

vp fT 

" .*. *. ; , 

-J 

•'- • 

*>' • 

? •' • 

• *.f • •• 

• • 

• ♦ 

•( :, • • 

.-• 

• ^ 


.'; • • 


< 

4 iN 

wP. 

B .03 

cocm ? . n'.— 

in cv 

IT: W 

ft? — ■ — P) 

If; CM '.;. 

CM;© 

■ »*i in : . i: 

•- <j r> 






. •»••’ •’ • 







* < 


■ a 

. V Vi OliV 

i u.:; sffi 

.. ** to : w 

■v>c: was 

- Vfr»jy 

(Tv I ^ 

•'if. 

H p 

..•„* r?f< 


<•% ,:V 

S «■ ;}f 

g o.'-'.', — cr 

<pt CT-..»e NCj 

‘II *7 : * ; 4! 

S? -■ -rl' —.ra 

H 3 


•- a|I -to 

m ac-5? y m© 

;5 Bfi£S 
*S* •'Vv 
•vp ryp cv ; .f< 


■Hi p»> n,f> 

ft! fvfe' — <* 
IM OOf" B ftl 

7» • :: • •• 

«• — >'■ <r cm 


■y-m m 

'. o -; l M 

;<• zivo 4 * 

in «•'{. mfv 

'7 

: p 

L; ; : . ••: 

::’*f ;w: : 

vDvJ 

1> oj , 


c‘; <f . : CO f fti 

•a? try- 

:'n<f 

M 

Xf*v v£>- CO 
in:^r 

O ' r 

a cm 

'■ f ^.05 

m oj,; 

uift! 

in 

fS O' ^ 

B tfj 

£1 • ♦ 

• • ... •* • 

. .4 


• •<• 

• 4 

<r r <*- ‘ o 

in - 

v£,' 

n 

4M • 0 

(V 0 

CM — 


§H |3 c.; 

IJui 

'M n£v, c\j;<u 
f-j v •4'.^ *.'• 
m ;tf) 

if&i ‘L.V* * ■ 

53 *’•; ... 

Sj| 

,«»| v. v 
«t* J *•'■ 
av... n ,® 

#-p:a^ 

;• 4*. •■:• 

— » ' O tf) 


js- &* 

<•* 0V< <t(.<S» 
v< &w to 
•'.* .?> 
■-* — . ftH*i 

-• -l: ,••:< 


CM — f Oi® 
;W n Vr,;P» 

iQ cop - r*«i© 
• •%" • • 

— lT;..fft.'-W 


W *M 

\&j. cv$f 
30 'Cl$ 

& •*' 

Ait Ct.i 


m f 

jS» Of: - 

lp N'-. • 

?*S p ” ■■ 

..4 • 


■» t i: 

'O' Waz 

* <tk 

B < ■:'{, 
if *-s 

1 * 

¥.«m 


ft) nfV; 

'■$ BebJ; 
'# *1 . 

PI o 


« • • 7 **z* 

t t •:. 


EXAMPLE 2: SAMPLE OUTPUT 



mu 4 




i;A> 




M 4 

ft* ■•’Q 


i 


#. 


' *s 

Me 


;Vt ™ 



. 4 '* ■ 
'■4 : .•• 




jyft 

.{M 




- •: r-ft? 

■ ... i 


iff ,*;■« 
Ifi ft! 




m 

’ a , 


•'Stt 


i?4? 'iv,=» 


% 


, • ^ 
: ; v \# 


L 


• ■ 4 .V, 


.{• •• .. 

il ' i 
o 


Z ' ; 
U . ' 

i -4 

k- » 


■ >; 


i! 6 fZ* 

u,„ 4?, ®; :• 

ft ft: O' < 

^ ; x > 

& •••-, uj 4 ' 

« W >. 1i 


K‘P 


r'; 


.{• ' 


pt 


*K» 

$■» 


S 


<* 


v< 


f. .’4 
:«$ 
s-vl 


f->- 

fti; 

p? 

jtj 

?•:• 

rU' : 


% m hb 

..*? #1 .ft 1 


•ft ,ft : 


J .• 

’ft 


■- .'.:• 


•fti 

4 : i 

• * 

• • 

• ‘ • • 

• • 

»• 



•ft 


u. 

U. 

' LL 

IL 

tL. 


* 



a 

0 

: O 

a 

a 



'tV* 

. t 

- '' z 

Z 

■ Z ' 

z 

z 

■ft 


■ V ’ 

u 

u «, 

u- 

u 

u 

.'> 




. 

k-4 

►-* 

*— < 

k-4 



j • 

• *. 1 

k- 

t- 

H 


k* 




•5 ' ; 

ft < 

< • 

C . 

< 

< 

■* r* 


3/ 

* i ■* 

z 

Z 1 

. z c ' 

z 

Z 


. ft 


’• • ‘ 

M, 

k-H 


M 

►-< 

. i"t< 

'"ft- 


■ft K 

' cn • 

■ •• CD : 

m 

O 

33 


’ V ft* 

. *. 

’A * ■ 

' 



3T 

fv 

'• ft.ft. 



u 

, a.".; 


u 

U 


> '• * -ft 




v u.- 

.. • ui 

w 

U 

- 

•' .* • V 


ft. ' 

ft >c •; 

. . X 

ft. 4 

X" 

X 

' . i 

■ 


' " 

iu 

• iu 


oj 

UJ 

v. ' ; t 


ft 

ft -ft v . r : 

> 

; ; > ‘, 

•ft >r 

> 

> 

• :V. 


v .- 

c<\* 

. z 

z 

;■* z / : 

z. 

z 


o 



.ft a- 

o 

.'• o’-. 

o 

a 


CM .■. 

t. 

•Sc 

u . 

u 


u 

u 


*■* 
. II 

CTr 


, t’- 

V UJ."- 
X> 

IU. 

r.« 

•ft HI 

•:, xjr . 

IX! 

u; . 

x 

' <A 

•' a- ' 


: *. eft ; ' 

•S .■* 

■ 

r; k*(^ 

•/ 


^ N 

VN‘ 

UJ 

Lft, 



M3 

<0 

' \o 

M3 

<0 

h . 




ft, !/>V<3 

in ic 

Uki© 

ir.'G 

00 sO 

U ■ 

k- 



• -M3 


■ K« 

»-4 \^) 


’ ‘ Zft 

Otf < 


“4 

V' • r* 

•-* 



•** 


c, O Cl 



’v' *** f 

• • 

• 

^ • 

m 

. . ir;\ 

• ^ LU . 

« 

J 

-V. rftjt 

- n it 

■ r :• 

h- Il 

r' ti 

ft ' 

P Uj 1- 


ftft.i 

.A v0'< 

<o^«i 

V M*«t 

v0< 

M3'< 

> Q. . 

o — 


ft’. MJ S 

■ M5X 

■ r : mji-x 

vcac 

OI 

/ i* tfirt 

II t 



ft >o a 

• •M’a 

... vo.a 

'0-Oi 

SU tt 

1 UJ 

a- - u : ' : 



ft:, - _) 

w 



- J 

. Zi 

_> . o 


‘•'j 

. »«i 

• < 

. •i** 

•<s 

• < 

’ v — r : 

■ 



■■ . 1! V 

II w 

11*^ 

11 «i» 

I! w 

l- £ 

-a a , 



.Vi <• 

< 

i'V 4-.. 

.<.:•; 

< 

=>?4; 

Z,0 UJ 



-ft K 

H 

" ■ '■ 

'V LfA , 

t-K 

K 

O . ■- 

-am , 



. UJ , 

<- III'-: 

UJ < 

UJ , 

. cr '■ 

2 112 


•3 

a- 

ai-iif 


(BUI . 

m 


UJ3 ; 
O Z 


ft • 

w**. 

w»" .• 

ft' ^ 

^ ft' 


z ■ 






* 


’■; ■ o ■ 

UJ UJ 



. CJ IU 

/ n; 

ft! <f!. • ’ • 

If) 

M3 


t- >- Z 


"Vi 

'i J 

v in 09 

$* ft ' 

45 " 

s 

i- 

<■■3 3 ■. 

3 ; 

•p) ,k 

• m as 

: 

ina 

■ < 

S>4 2 


ft! 

via: 

... tn w} 

^ to;H • 

CO — 

w j 

■ ' a 

— G — 


' 1 - 

v O 

. ■ <m 

,&<z ■ 

<a 

< J 

UJ 

k- tf) X ' 



. -JH 



_ia 

J« 

k-' 

in CD « 



-i." um 
& 

: u^9 

.... 

ft 1' 

uv) ; 

. . / 

. . _ .j. 

uu 

kM 

i* * 

Ui«S 

Alftr 

v*LiV 


3 1 
{ 


».;1 

•tV* 




H 

■% 


: 41 


z> 

CL 


o. 


<c 

to 


CNJ 

LU 

_l 

CL 


OJ 



h 

-i 



,*U 




w* 
■i m 


ra-r -ii’y' 

m te 
m m 

m i? ! 


W: m 


m % : ! ;i 

§p ■ -w 

m & 

» S&i !■•'( 

ifi 1 

oi-i 
goo o ; 

* »>. > i 

.S°S 0 'r' 

•• 

.pin n-v 
‘OrUI <ftt) i 
■iv ry<* oo ; ;. 
Iffopc A 
,pc$u>7- 

3; •= • • .?;■; 

:0 0:0 O A* 

m >¥ 

III) !i# it .£■ 

5s s» 

f*3 0J 

J§ 


I mzr 

m 2-2 z -*s 

;*? if-) 'fei 
Svj *\: «... 



« IP 
s*ss v 


m^ndrin 

<\j-n«£ : o 


wo ~« 


$ Si 


oo o o o 

.1 '; 


tt* ?•: 

~A $■ 


:.i f v S 


opO'^JO 

dacbc: • 

M© V)M or ' - 
«-®» 0& C :- 
WKa VO' ->.. 

r (6 n - 

CMSU r'.'-Cl'U 

TOb-a-if')© 

CD# I- 

•fef •£» • ■• 

OgDOOC : 

P v ; • 

\ r*v 


W,f6 5 <tito £ ' 


|c#o>| 
;w <t n tr-r f: 

© •tf yt? QJ' ’? 
•^wpo 
<t (V. : 

U' r-< <t P»-.'V 

5o nq"0 • ' 
O P:tf> <f 
00 ©W - •' 

• • * • 

O o o c -. ■ 

■f- 1 

(I II II II 

■/; si -V 

in •<- S» n» 

fj © ® - 
'V 

:*z*zS 

•IfeU-tLlL - 


.M? <•$* O : •»» 

p; ||?jjj 0 -£; 

Vrj ?gDSQfl 
: ,Vj IPuyfifsCS 
-p! Ooifiti :ji. 

.^,i vi;b? n •-> 

.5# >~W O PO <U,:» 
■>' z^ooiirt in*/? 
- ■ OJ.iVI ©iW ©' 

' ••* Dfoi <$S - 
• ?<*.< •' • 

■>• 2 o O O c 
0; | I 1. 
• 3 I« II H r H-: 

U. 

I aHg ^ 


». ■-' O"'* w.4> ,• . 

i : : t-iik x^s > :v-. 

■ •• u:^. 

m.Z|Z; 

• i >-^‘lL : lf U 


-ffoo 

0-0' o P 
I I 

GOOD 
op <MT 

wkbomo 

>• tn cun 

-o- m 

<f i 50 .P' W 

n* <3 IN-<r 
p;j?) tv >? 
•>. 

up oo 

Ijl V 

H# II dl 

OJ U> CD#* 
v.v- Lfe* 


‘p®® 


ij % 

-! - r-'jSo® 

■•-•:• ojo o^> 
. I e$ 

- .: G OGQ 

•r t'llfl" 03 

■ -;i?s 

• v-ltf s.-fl- 

I-^olftioor- 

Hi 5NJ W 00 

j -1 < t . g > -'jn 
'- i oj» cviw 
• '%' • * ? 
O’O O o 

;0: & I 

iO up ii# 

i 


> W' 

n IT® CD® 































O O ->( V 
oooo 
l i 

oocc 

\CNrt<r 

<rv tiuv 
-> m r- — 

in <v m — 
n r> ui i>) 







hOUO 





r- ^ n 

oooo 





n ( \jr~v 

i 





• • • • 

GOOD 





oooo 

CO O' X> <t 





1 1 1 1 

a- N vp in 





II II II II 

y io x : <j- 






N^If.O 





A, A 

IMffi'lCC 





n uj o tv 

u) c*- in 





•X 

OJ o ** <t 





w w w 

r- ro co -O' 





X * X A 

* • • • 






c o o c 





2ZZZ 

1 





U.HIUL 

II II II It 






^ 






m vo tr w 









CO 



. w %^r w w 



z 


o O — -i 

X: X X * 



<3 


0^00 




iLl CVJ CJ C\) (V CV C\l 


1 1 




rr. o o c c o o 


ocoa 






sQ Vi: O If; 




Q O O C G G C 


nj u»i r; r- 




uj io cn r -< «r v 0 


If) Od <\i V 

— --o o 



■ ■ s: <r r- vC ^ %o 

o 

\V r t ~ Cv: 

oooo 



ry ^ tn Tv 1 NOO 

o 

<to<riN 

1 I 



L m oc u ! o it! o 


«-* cvj o a: 

Lh £j O. C 


« 

11 N N Ai ■f ‘Jj "*■ 

c 

df — • N 

or r o- y 


C 55 X IT X 

■•/': cj ir ^ «• co 

ro 

ro ^ r< s. 

to n or o 


V” \/ w W w 

Z IP <r — . cv x ui 

r: 

• • • • 

a- u 1 <r a* 


m (\t cv r- 

^ n* <■ n> r*. r.! 

CT- 

o o o o 

CV o cr. ro 




T 

i i I i 

X <* <r «•» 


tr y fy rv <v 

K C O O r- O C 

(T* 

ii n n M 

<J vU C*- <M 




UJ 


-• o x <r 




u 

^ ^ 

x- 1*0 OJ — 




CM 

cv in a; — 

• • * • 




• 


oooo 


cvi c: tv r . i — 


c> 

W» W- 

1 1 


o o o o p: 



X x; ;< > 

II II II II 



t* 

II 

h f- h ^ 



C- O C C C 


■X 

z z z k 

*■* <*■*' 


vC C u '? O 



Itu X 

X- 10 C -1 


rv *>- tr c x O 


K 




<r-;uoo 

< 

Z 


W W — ' W 


u) w c cr-o 

— 

UJ 


x m -■ x 

f* 1 

r x n o 

tr 

3X 



l.. 

c, z ■ t' r~ u 

< 

X 




C* N r: re o 

> 


OOOO 


U 1 

CV r; <5 c — • 

O' **■* ^ •-« 

o 

O { — ; o 'X 


> 

• • * • • 

O* C O c L. o c 





< •> ’ c o P 


a 

O O C G 

- c C G 



L'CcC f ; c ,o 

u0‘ 

•x M *3-1 0 1 

r o c o 



Lnr j ~ « r 

w 

C UI -l; 

i 

-j 

V V V V V 

k. n u cr r: cv lT- 


0' ^ N 

cc ~ z 


> > ‘ > > *■ 

LX OU‘MT 0.0 

• 

kuicmv r f : 

n i o c r^> 


V V V V V 

C O’ 10 — • r — r- 

10 

^ n CJ < Or 

CT ^ O O 

K* 


U. r*. i_) u . ix. vi. 

v; 

iufroi’i 

cv ui r- rj 


— 0,. CV CV CV 

CO o LT ^ vC O 

< 

CT ^ ^ 

r>ai ^ ^ 

z 

n) o o o u 

Z rt o r>: in 

j 

G — — OJ 0* 

O cv u I- 

*— 


•o. uu <r a <r r ; r** 


< • • • • 

U CV Cv X 


C o O C: O 


(/i 

"COO'-) 

< O — pr; 

LX 

c vo oir cr- 

i- o a o r o f .'* 

M 

p 1 1 1 1 

a. — rv w 

o 

o c\j id mr 



II II II II 

• ♦ • « 

LL • 

c <r <X u u 



L L 

C 0.0 0 


omwooc 


X 

(J. ^ XX ^ -X 

a i 

w 

tr o r- ct n n 


o 

- -1- N C 

o n l| 11 li 

V- 

y c in (r r n 



w' — 

J— 

-J 

u c ~ n re r- 

CO 

• 

C W w w w 

VJ ^ ^ — 


— — o.; r ; <* <t- 

(/; — rvj ^ *f. *X? 

a 

V- X. X x > 

X — <t N C 

•y. 

o • • • • • 

< 

c 

G X K K 1- 

> - 

li; 

LOOOOO 

-J 

a 

G Z Z Z 2 

w w ^ w 

ry 

tr. i 



>ILIU.U. 

□3 x> x r cp 


EXAMPLE 2: SAMPLE OUTPUT 


GNVE^CRNCr IN L.T'/ir !TF^/>TI 0 NS 


f 4 i 

u l i I 


# if. 


03 re (0 co OQ 

w w ^ to. 

n I*; w rv 

a or a or c 

• •>. >• 


e\i rv t\l evi 
oo O oir> 

QC CCD 
IVMD5Q 

<o cv.n <_> b 
N5:»< x o 
to r r- m a 
o a - to a/ o 
9J If CTiPb 

to cv cm n q 
*-■ cv cm a if 

q o o o b 


v v.y v v 
¥■ ^ 

v. v v y v v 

" *H (V CM CV CM 

n o to c o 

£* © c.o a o 

osnrif 

•* Oto'CMCT.O 

••'4 o' N OU to aj 

$ OCPMI! 

mooffla'i 

s;, z o or in in.tn 
o o to cv cv r** 
v *-* r* *-* W Cv. (\J 

' C • • • • * 

luOoO O O 

t l a' » 


r- ct o 

in ■' O' cu 

ct -s — 

N — — 

O (3' O 


*,»>© < 

0000 

1 I I I 
QCCO 

s 

O' to *- CT 

mo n n 
s« nN 

no' o'W 

— :p* to «o 
D ; «V 

•, • • •'• 

OO OO 


00:00 
O O&I O ; 

QQfiO : 
It'D Alb 




*. * v; *! 

isN-.iag cM; • <?* 



m fit m it 

oioocm-j .<•: 




IONKN,'. •;(. 



^1 ^ 

vCCMCTCM" ‘ % 



CT to to CM 

«• cm «> r> ; 




U)NC\IOO- 



!' w ito w *it# 

to to CT to 



A X A. X 

• • y • 



to H> to to 

oooo: 



Z ZZ z 

;l ■ 



U. U. CL U- 

II II 11 11 , 




^ 




CT O' O' N 

CO 



to to w to 

Z 


tolTiT< 

m ID OD CD 

«, 


OOOO 


UJ CM CM CM CM CM CM 


till 


3E G oo o a o 


coup 




O CM — < N 


QCOCQCO 


o‘to N <* 


oj m < c- in to o 


O' V ) cu to 

-ooo 

S o <f on ou r > m 

o 

. to) CT — to 

oooo 

cr <- <m o in m <r 

o 

,;• « to to o 

1 

ON COM 4 CM to 


CM to CT O' 

oooo. 

Itoo-nMirin 

c 

<f CT to -I 

to ct in, s 

C/3 to' CT to CT CM 

to ' 

to C» ff; to 

to in o’ 

z-T'-if'csJv-to 

<t :■ 

• • • • 

CTU).U3<t 

< CT CM CM to to 

r~ :' 

OOOO 

1/3 CU (M CM ! ■ » . 

nr • • • • • 

CM . 

. f ~ : 

•a- in n cm;. 

0 

0 

0 

0 

0 

0 

1 

r-» . 

- . it it il (I 

to uu cm to • 


<r. 

■~r*, i *. . ' 

in -a 4 — • ' 

* 

n 

1 to'to 

CM O’ CM IV • 


■ «■* ■ 

CM .ip ai r», 

» • • •; 


• 

' • ‘M to 

oooo* 


O ‘ 

toito w to 

i i . " 



.CT X X X. 

1! ii ii if ■ 

to 

u 

1- to K to 

; 

to 

a? 

Z Z Z 2 

j 

u 


a . U. u. u. 

cm n n - ; 

z 

K- 


. to. 


S. 


V. S. to- w 

»— * 

u- • 


to CT 03 U' 

a 

a 



< 

Or' 



> 


■ O- <#• <Mf! 


O ** M «- 4 «H *—* 

0 

OOOO 


O r ' o c* a o o 


lilt 



Cl 

-: u o oc 

too oo 

O Cl oooo o 

c 

■■’ CT,<t N CM 

oooo 

toOtono—N 

LL 

U) if):to;to 

r 

eg - a; o -ct o <t 


U3 O to (M CT 

oooo 

U mmJJ r, b r> ct 

• 

I- rv to to O' 

cv to cn m> 

O c.' «m <r u rt m 

CO 

Z CT O to .to 

C7> <13 o n • 

U. N r* MT IT N « 

J ^ 

UJ U J to — to 

to to >c in. 

to ^ to « 00 0 CT 

< 

to <f to CM MJ 

« U) 00 0 

Z c- to to n u <* 

J 

O to-tofiitf) 

to — o cm: 

«i to to — CM CT to 

u 

< * • » • 

to to to <r 

£•••••• 

(/* , . 

a o c c o 

ct o «-< o: 

i- o o o o o o 

►—3 

is 

CT <M to — 


>. 

n ii it ii 

• • • • 



tie 

o o OC- 


u. 

CJ ^ 

oc i : 


c 

. .. ~ <t N’O 

c II II II II ; 



•OC to 

U* 

to 

• 

O w to w to 

* ’sj • 

to — w ct ^ ir. to 


1- K X >• X 

■ IL to c N O- 

< 

C •• 

W l- >; K >- 

> .. — : 

J 

or. • 

w z<*£ z z 

«r toiw w 

u 

Q 

> IL .IJ. H U. 

cn m cn © ®: 


EXAMPLE 2: SAMPLE OUTPUT 


47 


REFERENCES 

1. T. W. Anderson, An Introduction to Multivariate Statistical 
Analysis , John Wiley and Sons, New York, 1958. 

2. R. Fletcher and M. J. D. Powell, A rapidly convergent descent 
method for minimization, Comput. J. 6(1963), 163-168. 

3. L. F. Guseman, Jr., and Homer F. Walker, On minimizing the proba- 
bility of misclassification for linear feature selection, JSC 
Internal Technical Note, JSC-08412, Johnson Space Center, Houston, 
Texas, August, 1973. 

4. L. F. Guseman, Jr., B. Charles Peters, Jr. and Homer F. Walker, 

On minimizing the probability of misclassification for linear feature 
selection, Ann. Statist. 3(1975), 661-668. 

5. L. F. Guseman, Jr., and Bruce P. Marion, Obtaining initial vectors 
for minimizing the probability of misclassification, NASA Contract 
NAS-9-13894, Texas A&M University, Department of Mathematics, 

Report #1 , Sept. 1 974. 

6. L. F. Guseman, Jr. and Bruce P. Marion, LFSPMC: Linear Feature 

Selection Program Using the Probability of Misclassification, 

NASA Contract NAS-9-13894, Texas A&M University, Department of 
Mathematics, Report #3, January, 1975. 

7. D. G. Luenberger, Optimization by Vector Space Methods , John 
Wiley and Sons, New York, 1969. 

8. W. Robert Mann, Mean value methods in iteration, Proc. Amer. Math. 
Soc. 4(1953), 506-510. 



9. J. L. Solomon and B. Charles Peters, Jr., A simplified version 
of locating stationary points of the transformed probability of 
correct classification. Preprint. 

10. System/360 Scientific Subroutine Package, Version III, 5th 
Edition, Form GH20-0205-4, International Business Machines, 
August, 1970. 



METHODS FOR ESTIMATING PROPORTIONS 
OF CONVEX COMBINATIONS OF NORMALS 


By 

L. F. Guseman, Jr. and Jay R. Walton 

Department of Mathematics 
Texas A&M University 


Report #7 


Prepared For 

Earth Observations Division 
NASA/Johnson Space Center 
Houston, Texas 
Contract NAS-9-1 4689-4S 


April, 1976 



METHODS FOR ESTIMATING PROPORTIONS OF 
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L. F. Guseman, Jr. and Jay R. Walton 


1. INTRODUCTION 

The techniques in this report were developed to treat the following 
pro bl em : 

Given LANDSAT data (mul ti temporal ) over a LACIE sample segment, 
and representative samples of the classes present in the 
segment, estimate what proportion of the sample segment is in 
WHEAT. 

The approach to the above problem taken in this report can be summarized 
as follows: 

(a) The density function for each of the classes 
WHEAT and NON-WHEAT is expressed as an appropriate 
convex combination of multivariate normal densities 
with known means and covariance matrices (usually 
obtained from a training sample). 

(b) Feature selection is performed to produce a corresponding 
optimal one-dimensional Bayes classifier for 

WHEAT VS. NON-WHEAT whose associated confusion 
matrix is known. 

(c) Using the one-dimensional classifer and associated 
confusion matrix, an estimate of the true proportion 
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of WHEAT in the sample segment is made. In some 
cases, the resulting estimate is unbiased. 

The methods presented herein have the advantage that classification 
of multi temporal data over the sample segment is performed optimally in 
one-dimensional space thereby reducing significantly the computer time 
spent in classification. Another advantage is that the confusion matrix, 
used in obtaining unbiased estimates of the wheat proportions, can be 
reaily computed without the costly requirement of obtaining a labeled 
sample independent of the training sample. 

The general mathematical framework of proportion estimation 
procedures is discussed in Sections 2 and 3. In Section 4 we define 
four particular estimators based on the previous mathematical discussion. 
Section 5 contains preliminary numerical results of the four estimators 
presented in Section 4. 
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2. PRELIMINARY MATHEMATICAL DISCUSSION 

Let n ,...,11^ be distinct classes with true (but unknown) 


m 

a priori probabilities a , respectively. Let ft = uH. 

1 m i=l 1 

and let X : ft -> R n be a random vector with mixture density 

m 

f f v = ^ ou > 

* i=l 1 1 


where each class conditional density function 1S 


assumed 


to be N(y. ,£•) with Uj » £.j known, 1 < i < m . 


A method of estimating all m a priori probabilities a 

in the mixture f from a given sample was discussed in [1]. The 
estimation problem discussed in [1] resulted in solving the problem: 


minimize (|Pa - §(| (Euclidean norm) 

n 

subject to l a. = 1 , a. > 0 , 1 < i < m 
i=l 1 1 " ' " 

where e is the m-dimensional vector of proportions obtained by 
classifying a random sample of size N , and P is the mxm error 
matrix associated with the classifier used to obtain e; that is, 

P = (p_) , where 

P n -j -J f j(x)dx i, j = 1 ,2, . . . ,m 
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and R are given classification regions. If P is invertible, 

i m 

then Q. = is an unbiased estimate of a (which, in general, 

may not satisfy the nonnegativity constraints). 

The following discussion forms the basis for the estimation pro- 
cedures presented in the sequel. 

k m 

Let r = U n. ,r= un. . Then r and r have a 

i i=1 i 2 i=k+1 i 1 2 


priori probabilities y^ = o^+.-.+a^ and y = a k+ i + * • * +a m > 


respectively. Letting 

k a, 

h = l — ! - f. 

1 i=i y, 1 

and 


") a, 

h = l — f. 

2 1-E+l Y 2 1 


we have 


m 


f ' ill 

k m 

= l ot-f- + 7 a-f- 

1=1 1 1 i=k+l 1 1 

k a- m a.- 

= Y T — f, + Y 2 Y — f . 

H=1 Y ! 1 i =K+1 T 1 


Y h + Y h 
11 2 2 
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We note that the density functions h and h 2 are convex combinations 

of normals. Henceforth it will be convenient to denote the above expres- 
sion for f as a convex combinations of convex combinations by h ; 
that is h = Yj h^ + h^ . Suppose we are given decision regions S 

and S and associated decision function C : Q {1,2} defined for 

2 

each a) e ft by 

C(w) = i iff X(w) e S. , i = 1 ,2 . 

Then the probability that U3 e 9, is classified as belonging to I\ 
is given by 

Pr( [X e S,]) = Pr( [X e S.] n (r U r )) 

1 1 1 2 

2 

= Pr( u ([X e S.] n r.)) 
j=l 1 J 

2 

= l Pr( [X e s.] n r.) 
j=l 1 J 

2 

= l Y Pr{ [X e s,3 jr .) . 

3*1 3 J 

= Y Pr([Xe S . ] 1 T ) + y Pr([Xe S.]|r ) 

1 I I 2 12 

Let Z = (Z , Z ) T , where Z. = Xc o X and Xc is the characteristic 
12 ' 5 i i 

function of S i C R n . For a fixed i , 
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E(Z.) = ECxg (X)) 


= / Xc h(x)dx 
R n 1 

= j" h(x)dx 
S i 

= f ( Y A (x) + Y h (x))dx 
J 11 2 2 

s i 

= y f hj(x)dx + Y 2 f h (x)dx 
ls i 

= Yj P([Xe s i ]|r i ) + y 2 P([Xe s.]'|r 2 ) 


Let w = (a) , . . . ,to ) be a random sample of size N from ft. For 

1 2 

each fixed i , i = 1 ,2, let 


Z ir (w N ) = Z (u> r ) , 1 < r < N 

Then for each fixed i, Z. Z. M are independent random variables 

1 1 iN 

and each has the same distribution as Z^ (see [4]). Thus E ( Z r ) = E(Z..), 

/\ i N ^ N ^i 

1 < r < N . Letting d. = tt 7 Z. , we have dA ; = tt - » where 

" i in i ir i in 

N 

N. is the number of elements in oj that are classified as being from 

A 

V. . Letting d^ = E(d^) , we have 

N 


d i - E 'V = E < TT r J 1 Z ir> 

N 


1 jE(Z 1r ) = ' y E(Z,) 


N 

l 

r=l " 11 r=l 

= E(Z i ) = YjPUXe S . ] | r t ) + Y 2 P ( t X e S.]^) 
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Then, if 



we obtain 

d = E(d) = Oy , 

i. L. 

where Q is the 2x2 matrix whose entry q., , in the i tn row and 

i. I_ 

j tn column, is given by 

q ij = f h j^ dx i ,3 = 1 ,2 . 

Si 

The error matrix Q is determined by the classification regions 
S and S and the true class conditional density functions h 

1 Z 1 

and h for r and r , respectively; that is, h and h in 

2.12 12 

terms of the true a priori probabilities, a ,a . If, in 

12 m 

addition, the regions and are to be determined by h , 

h and h , as in Bayesian classification, then S and S 

12 12 

are also functions of a . 

i n 
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3. GENERAL PROCEDURE FOR DEFINING ESTIMATORS 


Each of the estimators presented in Section 4 results from using 
the following general procedure to determine appropriate decision regions 
and associated error matrices. 

Begin by specifying values of B = (8 ,B )"*" » B > 0 , B > 0 , 

12 1 * 2 ~ 


m 


B + B - 1 , and n = (n,...»n_) , n. > 0, 1 < i < m 

? 2 m i - 


to produce approximating conditional densities 

h , (n : X) = J. ^T f i< x) ! V , = 

1 - I 1 1-1 

m n- m 

h 2 (n : x) = . I f i (x) ; v 2 = ^ n i 

2 i=k+l v 2 1 2 i=k+l 1 


l n i = 1 , 

i=l 1 


and approximating mixture density 


h(B, n : x) = B h (n : x) + B h {n : x) . 
11 2 2 


Once B and n have been specified, an existing feature selection 

technique is used (see [2]) to produce a l*n vector B* of norm 
one which minimizes the transformed probability of misclassification 
in one dimension; that is, a B* with ||B*|| = 1 is found which 
minimizes the function g (of B only) defined by 


9(B) = B 


J 


h (n : y,B)dy + B 
1 2 


/ h 2 (n : y,B)dy , 
S (B) 2 

i 


where the transformed densities (as a function of nonzero B) are 
defined for ye R 1 by 
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^(y.B) = 


(2H) 1 / 2 (BZ jB T )V2 eXP 


i (y I BP 1 ) 2 \ 

2 BZ^.B 1 J 


k n- 

h (n : y,B) = l - 1 f.(y,B) 

1 i=l 1 

m n- 

h (n : y,B) = I rr 1 f.(y,B) 

2 i=k+l v 2 1 


1 » 2 9 . . . ,m. 


and the associated Byaes decision regions are given by 

S (B) = {ye R 1 : 6 h (n : y,B) > B h (n : y,B)} 

1 1 1 2 2 

S (B) = {y e R 1 : B h (n : y,B) > B h (n : y,B)} . 

2 2 2 1 1 

The resulting associated error matrix Q at B* is given by 
Q = (q i j) > where 



f Mn : y,B*)dy , i ,j = 1,2 . 
S f (B*) 


Having determined the decision regions S (B*) and S (B*) , the 

1 2 

classification rule 

(*) C(<o) = i iff B*(X(a») ) c S.(B*) 

is used to classify the random sample co N to produce a 2-dimensional 
vector of (classification) proportions. 
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4. SPECIFIC ESTIMATORS 

We now discuss several methods for estimating y . The first 
(ESTIMATOR 1) is nothing more than an obvious modification of the 
m-class estimator discussed in Section 2 and [1]. It is used in the 
subsequent discussion to obtain other estimators. 

ESTIMATOR 1 

The procedure for estimating a - (a , ...,a )"*" discussed in 

i m 

Section 2 and [1] produces a vector a = (a minimizing 

m 

||Pa - §|| and satisfying £ a. = 1 , a. > 0 , 1 < i < m . Then 

i=l 1 1 ' ‘ ‘ 



m 


= Aa 

is an estimator for y . If P is invertible and P~^e satisfies the 
nonnegativity constraints, then a = P _1 e and y= AP -1 e is an 
unbiased estimate of y . 

ESTIMATOR 2 

Using the m-class estimator a = (a^ . . . ,a m ) T , and y= (y , 
we obtain the conditional densities 


< 



and mixture density 


h(x) = h( y,a : x) 


A A 


= Y h (a : x) + y h (a : x) 
11 22 


= Y h (x) + y h (x) . 

11 2 2 

The subsequent feature selection produces (at the minimizing B*) the 
decision regions 


S = {y e R 1 : yh (y,B*) > yh (y,B*)) 


i i 


2 2 


S = {ye R 1 : yh (y,B*) > y h (y,B*)l 
2 2 2 1 1 


A A 


and associated error matrix Q = (q..) , where 

^ J 


J 




(y,B*)dy , i, j = 1, 2. 


S. 

l 


Using the classification rule (*) with the decision regions S , S to 

1 2 

classify the random sample = (w , we obtain the vector 


of proportions 
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The resulting problem 

A A 

minimize 1 1 QC - d 1 1 

subject to £ + £ =1 , £. > 0 , i = 1 

12 * ~ 

/\ 

is readily solved to produce the estimator y of 

"1 /v 

invertible and Q" d satisfies the nonnegativity 

Y= q d . 

ESTIMATOR 3 

Letting n = ( ^ , • • • , ^ ) T , 6 = ( \ . ]-) T 

conditional densities 

1 k 

h (x) = h (n : x) = t- l f - ( x ) 
i i * i=1 i 

h (x) = h (n : x) = srj- . I glx) , 

^ i=k+l 

and the mixture density 

h(x) = h(n,B : x) 

= j h (n : x) + j h^Cn : x) 

= 1 h (x) + i h (x) . 

£ 1 C- 2 


2 

A 

y . When 0 is 
constraints, then 


we obtain the 


The subseouent feature selection produces (at the minimizing B*) the 
decision regions 
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S = {y e R 1 : h (y,B*) > h (y,B*)} 

1 1 2 

S 2 = {ye R 1 : h (y,B*) > h (y ,B*) > 
and associated error matrix 0 = (q..) where 

^ij = f h j(y’ B *) d y » i. J = 1. 2 . 

*1 

Using the classification rule (*) with the decision regions S , S , 

1 2 

we obtain the vector of proportions 



2 


The resulting problem 

minimize | |Q£ - d| | 

subject to £ + £ =1, £. > 0 , i = 1, 2 

12 1 - 

is readily solved to produce the estimator y of y . When Q is 
invertible and 0~^d satisfies the nonnegativity constraints, then 
Y = Q _1 d • 

ESTIMATOR 4 

Using the decision regions S , S and B* determined in 

1 2 

ESTIMATOR 3, and conditional densities h , fi from ESTIMATOR 2, 

1 2 

_* * . 

let Q = { q - . ) , where 
* 0 
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q*j = f h j (y,B*)dy , i, j = 1, 2 . 

§ i 

When 0 is inwertible let 
y* = y ± (y - Q" 1 Q* y) . 

Then y* is an estimator of y. If y = 0"^d and y = AP -1 e 
y* = Y ± Q -1 (d - Q*AP _1 §) , 


, then 


and, for either choice of sign, y* is an unbiased estimator of y . 
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5. PRELIMINARY NUMERICAL RESULTS 

The four ESTIMATORS discussed in Section 4 have been implemented 
(FORTRAN PROGRAM ESTPRO) and undergone preliminary testing. Testing was 
accomplished using 16-dimensional data from four registered passes 
(May 5, May 23, June 11, June 29, 1973) of LANDSAT 1 MSS measurements 
acquired over Hill County (N), Montana. Training data was provided to 
the program for the five classes: WHEAT, FALLOW, BARLEY, GRASS, 

STUBBLE. A random sample of 16-dimensional vectors of si 2 e 2417 
comprised of the above five classes in the following proportions was 
used : 


CLASS # OF VECTORS TRUE PROPORTION 


WHEAT 

784 

.3244 

FALLOW 

244 

.3078 

BARLEY 

300 

.1241 

GRASS 

206 

.0852 

STUBBLE 

383 

.1585 


The results for ESTIMATORS 1-4 in estimating the proportions of 
WHEAT VS. NONWHEAT appear in Tables 1-4. The estimated proportions 
obtained from ESTIMATOR 4 using both plus and minus signs are included. 
Results for estimating the proportions of BARLEY VS. NON-BARLEY appear 
in Tables 5-8. The results from all four estimators are summarized in 
Table 9 for WHEAT VS. NON-WHEAT and Table 10 for BARLEY VS. NON-BARLEY. 

The feature selection program used in ESTPRO is LFSPMC( VERSION 2) 
discussed in [2]. Solution of the constrained least squares problem 
(when needed) is accomplished using LSI from [3]. 


> 
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P = 


0.71597 

0.00182 

0.19020 

0.08376 

0.01057 

0.00463 

0.64462 

0.00018 

0.12748 

0.45221 

0.12068 

0.00000 

0.80158 

0.00000 

0.00002 

0.15869 

0.17698 

0.00805 

0.78348 

0.16139 

0.00002 

0.17658 

0.00000 

0.00028 

0 . 37581 , 


Error Matrix 


g = 


. 27927 n 
.26107 
. 1 3860 
. 1 8866 
'. 13240 , 


Classification vector 


/. 34499 X 
/ .21119 \ 
0 = .12096 

\ .06987 I 

\. 25299 / 


WHEAT 

FALLOW 

BARLEY 

GRASS 

STUBBLE 



WHEAT 

NON-WHEAT 


ESTIMATOR 1 


Table 1. 


ESTIMATOR 1: 


WHEAT- VS. NON-WHEAT 



-< » Cl> XD> -<> 
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/. 34499 \ 
y. 65501 / 

/. 90271 
\. 08729 

/. 34050 ^ 
\. 65950 j 

/. 31918 > 
\. 68082 j 


WHEAT 

NON-WHEAT 


From ESTIMATOR 1 


.07694 

.92306 


Error Matrix 


Classification Vector 


WHEAT 

NON-WHEAT 


ESTIMATOR 2 


Table 2 


ESTIMATOR 2: 


WHEAT VS. NON-WHEAT 


-<! l 
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/. 93341 . 1 1 058 \ 

Q = ( ) Error Matrix - 

\. 06659 .88492 / 


/. 37319 \ 

d = ( ] Classification Vector 

\ .62681 / 


/. 31541 
\. 68459 


WHEAT 
NON- WHEAT 


ESTIMATOR 3 


Table 3. ESTIMATOR 3: WHEAT VS. NON-WHEAT 
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/. 34499 \ 

WHEAT ) 


[ From ESTIMATOR 1 

\ .65501 / 

NON-WHEAT ) 

/. 31541 \ 

WHEAT ) 

( ) 

> From ESTIMATOR 3 

\. 68459/ 

NON-WHEAT ) 


t 


''.93341 .11058\ 

Q = ( ) Error Matrix From ESTIMATOR 3 

06659 .88492 / 


/. 36318 \ 

d = ( ) Classification Vector From ESTIMATOR 3 

\ .62681 / 


t: 


.93341 . 1 0348 \ 

Q=( ) Error Matrix 

.06659 .89652 / 


Y (plus sign) = 


Y*(minus sign) = 


. 32470 \ 

WHEAT 

.67530 / 

NON- WHEAT 

. 36529\ 

WHEAT 

.63471 / 

NON- WHEAT 

ESTIMATOR 4: 

WHEAT VS 


ESTIMATOR 4 


ESTIMATOR 4 
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P 


0.71597 

0.00182 

0.19020 

0.08876 

0.01057 

0.00463 

0.64462 

0.00018 

0.12748 

0.45221 

0.12068 

0.00000 

0.80158 

0.00000 

0.00002 

0.15869 

0.17698 

0.00805 

0.78348 

0.16139 

0.00002 

0.17658 

0.00000 

0.00028 

0.37581 


1 

> 


Error Matrix 


e = 


/.27927\ 
.26107 \ 
.13860 

.18866 I 

0 3240 / 


Classification vector 


( .34499\ WHEAT 

.21119 \ FALLOW 

.12096 BARLEY 

.06987 J GRASS 

.25299/ STUBBLE 


( .12096 
.87904 


BARLEY 

NON-BARLEY 


ESTIMATOR 1 


Table 5. ESTIMATOR 1: 


BARLEY VS. NON-BARLEY 
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( .12096 
.87904 


BARLEY 

NON-BARLEY 


From ESTIMATOR 1 


( .93122 .00805 

.06878 .99195 


Error Matrix 


( .12329 
.87671 


Classification Vector 


( .12484 
.87516 


BARLEY 

NON-BARLEY 


ESTIMATOR 2 


Table 6. ESTIMATOR 2: BARLEY VS. NON-BARLEY 
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( .98549 .02169 

.01451 .97331 


Error Matrix 



Classification Vector 


( .12817 
.87183 


BARLEY 

NON-BARLEY 


ESTIMATOR 3 


Table 7 


ESTIMATOR 3: BARLEY VS. NON-BARLEY 
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/ .12096 
\ .87904 


BARLEY 

NON-BARLEY 


From ESTIMATOR 1 


( .12817 \ BARLEY 

.87183 I NON-BARLEY 


From ESTIMATOR 3 


( .98549 .02169 

.01451 .97831 


Error Matrix From ESTIMATOR 3 


( .14522 \ 

1 Classification Vector From ESTIMATOR 3 

.85478 J 


Q 


* 


( .98549 .03115 

.01451 .96885 


Error Matrix 


Y*(plus sign) = 


Y*(minus sign) = 


/ .11955 \ 

BARLEY 

\ .88045 J 

NON-BARLEY 

1 .12233^ 

\ BARLEY 

\ .87762; 

1 NON-BARLEY 


ESTIMATOR 4 


ESTIMATOR 4 


Table 8. ESTIMATOR 4: BARLEY VS. NON-BARLEY 
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WHEAT 

NON-WHEAT 


TRUE EST 1 EST 2 EST 3 EST 4(+) 

.3244 .3450 .3192 .3154 .3247 

.6756 .6550 .6808 .6846 .6753 


EST 4(-) 

.3653 

.6347 


Table 9. ESTIMATORS 1-4: WHEAT VS. NON- WHEAT 



TRUE 

EST 1 

EST 2 

EST 3 

EST 4(+) 

EST 4(-) 

BARLEY 

.1241 

.1210 

.1248 

.1282 

.1196 

.1224 

NON-BARLEY 

.8759 

.8790 

.8752 

.8718 

.8805 

.8776 


Table 10. ESTIMATORS 1-4: BARLEY VS. NON-BARLEY 
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1.0 INTRODUCTION 

The following is intended as a users guide for the FORTRAN program 
ESTPRO. Program ESTPRO provides the necessary computations for performing 
proportion estimation by the four methods discussed in [33 • 

The estimation algorithms available in ESTPRO were developed to 
treat the following problem: 

Give LANDSAT data (multi temporal) over a LACIE sample segment, 

and training data for the classes in the segment, estimate 

what proportion of the sample segment is in WHEAT. 

The program assumes that a finite number of component classes (e.g. 
crops) are present in the segment, and that each component class is 
described by a multivariate normal density function with known mean vector 
and covariance matrix (usually obtained from a training sample). 

Under the above assumptions, the estimation algorithms performed by 
ESTPRO can be sumnarized as follows: 

(a) The density function for each of the classes WHEAT 
and NON-WHEAT is expressed as an appropriate 
convex combination of the component multivariate 
normal density functions. 

(b) One or more feature selections are performed to 
produce corresponding optimal one-dimensional Bayes 
classifiers for WHEAT VS. NON-WHEAT whose associated 
confusion matrices are known. 

(c) Using the one-dimensional classifiers and associated 
confusion matrices, estimates of the true proportion 
of WHEAT in the sample segment are made. 



- 2 - 


2. SUMMARY OF ESTIMATORS 

The following discussion forms the basis for the estimation procedures 
in ESTPRO. 

Let II be distinct classes with true (but unknown) a priori 

m 

probabilities a ,...,a , respectively. We assume that UL has mixture 

1 m i=l 1 

density 

m 


f = f x = I a i f i 
* i=l 1 1 


where each class conditional density function f. = f^ is assumed to 

be N(u.,£..) with y. , E.. known, and E^ positive definite, 1 < i < m. 
k m 

Let r = U n. , r = U II. . Then r and r have a 


i=l 


i=k+l 


priori probabilities y = a +...+a^ and y^ = a^ + ^+. ..+a m , respectively. 


i i 


Letting 

h 


k a- 

l ~ f- 
1=1 Y ! 1 


and 


m a. 

h - I y- f, . 

2 1 =k+l Y , ' 


we have 


f = l a.f . = y h + y h , 
i=T 11 1 1 22 



-3- 


where the density functions h and h are convex combinations of 

1 2 

normals. Henceforth it will be convenient to denote the above expression 

for f as a convex combination of convex combinations by h ; that is 

h = y h + y h . 

11 2 2 

Throughout, x ,...,x N will denote a random sample of n-dimensional 
vectors from the sample segment. Feature selection is performed using 
the algorithm LFSPMC from [2]. The constrained least squares problem 
(constrained quadratic minimization) is solved using LSI from [4], 

We now summarize the four algorithms available in ESTPRO for estimating 

Y = (y >Y ) T • 

1 2 

ESTIMATOR 1 

Step 1 . Using the mixture density 


f = l l f, 
m 1=1 1 


9 


perform feature selection to obtain a l*n vector B* of norm one which 
minimizes 


9(B) = 


where. 



R.(B) = yeE 1 : f.(y,B) = max f.(y,B) 
1 ( 1 l<j<m J 


, 1 < i < m , 


f i (y »B ) ~ NfBUj, be.b t ) . 


and 
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Step 2. Compute the mxm error matrix P = (p..) associated with 

* J 

"ic ic 

the decision regions R. (B ) defined by B , where 
p ij -f fj(y.B*)dy . i ) j = 1 ,2, . . . ,m . 

R i ( B *) 

Step 3. Using the decision regions R|(B*), 1 < i < m , classify 

the random sample x to obtain the mxl classification vector 

A t - N - ' 

e = (e i ,...,e m ) , where e^. = , and PL is the number of x^ in the 

sample such that B*x^ e R.(B*) , 1 < i < m . 

Step 4. Using P and e , determine a = (a .. ,a m ) T which 

m 

minimizes 1 1 Pa-e | j subject to £ a. = 1 , a. > 0 , 1 < i < m . 

i=l 1 1 " ' " 


Step 5 . ESTIMATOR 1 is given by 



= Aa • 

If P is invertible and P _1 e satisfies the nonnegativity constraints, 
then a - P _1 e and y = AP _1 e is an unbiased estimate of y. 


ESTIMATOR 2 


Step 1 . Perform ESTIMATOR 1 to obtain a = 


(ci and 


~ -,T 


y = (y ,y ) and let 
1 2 


k a. 


1 1=1 Y 


^ m a. 

» ■ I . 

2 1=k+1 Y 1 

2 


Step 2 . Using the mixture density 

A A A A A 

h = y h + y h , 

11 2 2 

perform feature selection to obtain a l*n vector B* of norm one which 
minimizes 


f My,B)dy , 

S (B) S (B) 2 

2 1 

where 


g(B) 




h i (y»B)dy + 


S (B) = {y e E 1 : y h (y,B) > y h (y,B)} 
1 11 “22 


S (B) = {y e E : a h (y,B) < a h (y,B) } 
2 11 2 2 


Step 3. Compute the 2x2 error matrix Q = (q..) associated with 

* 3 

A /\ 

the resulting decision regions S = S (B*) and S = S (B*) defined 

11 2 2 

by B* , where 
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Step 4 . Using the decision regions S j , S^ , classify the random 
sample x ,...,x N to obtain the 2x1 classification vector 

A A A J A N • 

d = (d i> d 2 ) , where d = , and is the number of x^ in 

* A 

the sample such that B x. e S. • , i = 1,2. 

J ' 

J A A T 

Step 5. ESTIMATOR 2 is given by that Y = (y »Y ) which minimizes 

1 2 

||QC-d|| subject to £+£ =1,? > 0 , £ >0. When Q is invertible 

12 1 ” 2 - 

A j A A jA 

and Q d satisfies the nonnegativity constraints, then y = Q d . 


ESTIMATOR 3 


Step 1 . Using conditional densities 
k 


f t , 

1 K i=l 1 


R If. 

2 m " k i=k+l 1 


and mixture density 


h = j h + 1 h 


perform feature selection to obtain a l*n vector B of norm one which 
minimizes 


g ( B ^ = \J h ,(y.B)dy + j J h (y,B)dy 

C f n\ l C * / r fn\ 2 


s .(B) 
2 


s (B) 


where 
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S (B) = {y e E 1 : h (y,B) > h (y,B) } 

1 1 “2 

S (B) = {y e E 1 : R (y,B) < h (y,B)> . 

2 12 

Step 2 . Compute the 2x2 error matrix p" = (q..) associated with 

^ J 

the resulting decision regions S = S (B*) and 5 = 5 (B*) defined 

11 2 2 

by B* , where 

= / 5 ii j (y ’ B * )dy 
i 

Step 3. Using the decision regions S , S 2 , classify the random 

sample x ,...,x M to obtain the 2x1 classification vector d = (d ,d ) T 
1 in 12 

- N i 

where d^ = jq- , and N. is the number of x^ in the sample such that 
B*x . e S. , i = 1, 2. 

J * 

Step 4. ESTIMATOR 3 is given by that y = (y ,y which 

1 2 

minimizes | |Q E, - d| | subject to ? +£ = 1 , £ > 0 , £ > 0 . When 

12 1 ~ 2 “ 

Q is invertible and Q" *d satisfies the nonnegativity constraints, then 
y = 1 d . 

ESTIMATOR 4 

“ /V A. ^ J 

Step l . Perform ESTIMATOR 1 to obtain a = (a » 

y = (y >y ) T and subsequent conditional densities 
12 

Step 2 . Compute B* and decision regions 5^ and $ 2 from 
ESTIMATOR 3, and obtain Q, d . 
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/v k $. 

h ■ y a f * , and 

1 i=l V z 1 


/v 


h 

2 


m 

i=L, 


A 



2 


Step 3 . 


Compute the 2x2 error matrix 


* 


Q 


(qt.) , where 


’ij 


■/ 


hj(y»B )dy , i ,j 



1,2 . 


Step 4. When Q is invertible, ESTIMATOR 4 is given by 
Y * = Y + (y - Q- 1 Q* y ) . > 


If y - 1 d and y = AP" 1 e then 

Y* = y + Q" Hd - Q AP" l e) , 

and, for either choice of sign, y is an unbiased estimator of y 
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3.0 PROGRAM PARAMETERS 

Apart from the various program parameters and command cards 
(discussed in the sequel), the basic input data to ESTPRO consists of 
the class names, mean vectors and covariance matrices which comprise the 
component class statistics deck . All input data to the program is from 
unit reference 5 (usually punched cards). All output from the program is 
printed on unit reference 6. Several additional options are built into 
the program which provide the user with the capability of making successive 
runs using designated subsets of the original features provided by the 
component class statistics deck. 

3.1 Parameter Initialization 

All input variables to the program are of a fixed format and must 
be entered as shown in Section 4.0 and as illustrated in the examples in 
Section 5.0. These variables are: 


MTOT : Number of classes in the component class 

statistics deck. 

NFPC : Number of features per class in the component 

class statistics deck. 

N : Dimension of feature space, < NFPC. 

CLS : Class names, 12 characters, double subscripted 

array. 

KCLS : Numeric labels of the designated classes from 

the MTOT classes in the component class statistics 
deck, single subscripted array. 

IFEA : Numeric labels of the N designated features 

from the NFPC features in the component class 
statistics deck, single subscripted array. 

COVARB : Input covariance matrices, triple subscripted 

array. 
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XMEANB : Input mean vectors, double subscripted array. 

ICMB : Numeric labels of component classes as defined 

in vector KCLS used in defining convex combina- 
tions (Need not be in ascending order), double 
subscripted array. 


Command codes select program options as follows: 


STAT : definition and entry of a given component class 

statistics deck. 

FEAT : definition of a designated subset of features 

from the current component class statistics 


EST1 

EST2 f . choice of estimator to be used with current 

EST3 | : statistics deck and designated subset of 

EST4 \ features. 


When the STAT command is used, values of MTOT and NFPC for the new 
statistics deck are entered. The names for the respective component 
classes in the statistics deck are defined on succeeding cards. The com- 
ponent class statistics deck, comprised of the MTOT mean vectors in the 
order of ascending class numbers followed by the MTOT covariance matrices 
in the order of ascending class numbers, is entered. The entries of each 
mean vector in the order of ascending feature number are entered according 
to the format (5X, 5015. 8). The NFPC(NFPC + l)/2 elements on and above the 
diagonal of each covariance matrix are entered by column in the format 
(5X, 5D15.8). It is assumed that the diagonal elements of each covariance 
matrix are in order of ascending feature number. The first entry of each 
new mean vector or covariance matrix starts on a new card. The entire 
statistics deck with appropriate class names is printed. 
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If the FEAT command is selected, a new value for N and the 
numeric labels of the desired features (IFEA) are entered and printed. 

Choice of estimators is made by using one of the command cards EST1, 
EST2, EST3 or EST4. 

Once a particular estimator is chosen, successive cards 
are used to define convex combinations of the component classes. Each 
card consists of the numeric labels of the desired component 
classes defining that convex combination. If each component class is a 
separate convex combination (e.g., as in EST1), then a single card 
with the numeric labels of all component classes is used. After the con- 
vex combinations are defined, the names of the component classes defining 
the convex combinations and their respective a priori probabilities are 
output. Parameters initialized using the STAT and FEAT commands remain 
in effect until the respective command is again used. 

The N-dimensional sample pixels to be used in generating classifica- 
tion vectors are entered using a variable FORMAT (read in at object 
time). If available, the number of sample pixels in each component class 
is entered. Otherwise, any positive numbers can be entered for each 
component class with the restriction that their sum equals the total 
number of sample pixels. 

Use of EST2 or EST4 requires intermediate determination of EST1 
and consequently definition of two sets of convex combinations and two 
classifications (see section 5.0). 



- 12 - 


4.0 OPERATING PROCEDURE 

In order to simulate object time dimensioning, the user must 
provide a calling routine of the following form: 

DIMENSION ALRGE(IDIM) 

DOUBLE PRECISION BLRGE( I DIM2) 

COMMON MX, NX 
MX = 

NX = 

CALL PRDIM(ALRGE.BLRGE) 

STOP 

END 

The values of MX, NX, IDIM and IDIM2 are determined as follows: 

MX = maximum value of MTOT for the program run. 

NX = maximum value of NFPC for the program run. 

IDIM = MX(23+4MX+NX(^y-))+NX(|NX+|)+12 

IDIM2 = MX(7+3MX+^|— +3NX+2NX 2 )+NX(~ + ll-)+7 

If available storage is not a problem, the user can incorporate maximum 
fixed dimensions into the program. 

Input parameters are of a fixed format and must be in a specified 
order. Shown below are the variable names as described in Section 3.0 
and the card formats for the command code sequences. 
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Statistics Definition: 

"STAT" ,MT0T,NFPC 

class names (one per card) [F0RMAT(3A4)] 
mean vectors [F0RMAT(5X,5D15.8)] 

covariance matrices [F0RMAT(5X,5D15.8)] 

Feature Definition: 

"FEAT",N [F0RMAT(A4,I2)] 

IFEA [ FORMAT ( 24( I2,1X) ) ] 

Several cards may be used to define IFEA if N >24. 


Selection of Estimator 

11 EST1",MT0T,N, 00000001 

all class labels 

number of sample 

pixels/class 

variable FORMAT for 
sample pixels 

sample pixels 

"EST2\MT0T,N, 00000001 

all class labels 

number of sample 

pixels/class 

variable FORMAT for 
sample pixels 

sample pixels 

class labels, convex 
combination 1 

class labels, convex 
combination 2 


[F0RMAT(26(I2,1X) ,A2) ] 
[F0RMAT( 16(14, IX))] 

[F0RMAT(20A4)] 

according to variable FORMAT 

[F0RMAT(26(I2,1X) ,A2) ] 

[FORMAT (16(I4,1X))] 

[ FORMAT (20A4)] 

according to variable FORMAT 
[F0RMAT(26(I2,1X) ,A2) ] 

[ FORMAT (26(12,1X) ,A1) ] 
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number of sample 
pixels/class 

"EST3",MT0T,N, 00000001 

class labels, convex 
combination 1 

class labels, convex 
combination 2 

number of sample 
pixels/class 

variable FORMAT for 
sample pixels 

sample pixels 

"EST4",MT0T,N, 00000001 

all class labels 

number of sample 
pixels/class 

variable FORMAT for 
sample pixels 

sample pixels 

class labels, convex 
combination 1 

class labels, convex 
combination 2 

number of sample 
pixels/class 


[ FORMAT (16(I4,1X))] 

[ F0RMAT(26 ( I 2 , 1 X) ,A2) ] 
[F0RMAT(26(I2,1X) ,A2) ] 

[ FORMAT (16(I4,1X))] 
[F0RMAT(20A4)] 

according to variable FORMAT 

[F0RMAT(26(I2,1X) ,A2)] 

[ FORMAT ( 1 6 ( I 4 , 1 X) ) ] 

[ FORMAT (20A4)] 

according to variable FORMAT 
[F0RMAT(26(I2,1X),A2)] 

[F0RMAT(26(I2,1X) ,A2) ] 

[ FORMAT (16(I4,1X))] 


If the same statistics deck and sample pixels are being used with 
different estimators, then the variable FORMAT and sample pixels need not 
be re-entered. If more than twenty-six component classes constitute a 
single comvex combination, a slash (/) in column 79 of the current card 
indicates a continued definition of the convex combination on succeeding 


cards. 
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5.0 EXAMPLE INPUT 

Example 1 . 

A 5 class, 16 dimensional component class statistics deck of MSS 
measurements from Hill County, Montana, is entered. ESTIMATOR 1 is then 
called to estimate the proportions of all five classes using a random 
sample of 2417 pixels. Then ESTIMATOR 2, ESTIMATOR 3 and ESTIMATOR 
4 are selected to estimate the proportion of class 1 (WHEAT) versus 
classes 2-5 (FALLOW, BARLEY, GRASS, STUBBLE) using the same statistics 
deck and sample pixels. 

Col. 1 

STAT0S1 6 

WHEAT 

FALLOW 

BARLEY 

GRASS 

STUBBLE 

statistics deck 
EST1051 600000001 
01,02,03,04,05 
0784,0744,0300,0206,0383 
(8X,16I3,24X) 

sample pixels 
EST2051600000001 
01,02,03,04,05 
0784,0744,0300,0206,0383 
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01 

02,03,04,05 

0784,0744,0300,0206,0383 

EST3051600000001 

01 

02.03.04.05 

0784,0744,0300,0206,0383 

EST4051600000001 

01.02.03.04.05 

0784,0744,0300,0206,0383 
01 

02.03.04.05 

0784 , 0744 , 0300 , 0206 , 0383 

Example 2 . 

The component class statistics deck and sample pixels from Example 
1 are entered. For this run, ESTIMATOR 1 is called to estimate the pro- 
portions of all five classes. Then ESTIMATORS 2-4 are selected to 
estimate the proportion of class 3 (BARLEY) versus classes 1, 2, 4, 5 
(WHEAT, FALLOW, GRASS, STUBBLE). 

Col. 1 

STAT0516 

WHEAT 

FALLOW 

BARLEY 

GRASS 


STUBBLE 
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statistics deck 
EST1041500000001 

01,02,03,04,05 

0784 , 0744 , 0300 , 0206 , 0383 
(8X,1 6I3.24X) 

sample pixels 
EST2051 600000001 

01.02.03.04.05 

0784,0744,0300,0206,0383 
03 

01.02.04.05 

0784,0744,0300,0206,0383 

EST3051 600000001 
03 

01.02.04.05 

0784,0744,0300,0206,0383 

EST4051 600000001 

01.02.03.04.05 

0784 , 0744 , 0300 , 0206 , 0383 
03 

01.02.04.05 

0784,0744,0300,0206,0383 
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COMPUTER PROGRAM DOCUMENTATION 


Program NONLN1 and N0NLN2 
Nonlinear Color Display Program 

Abstract . These programs together perform a transformation of a four 
dimensional real row DATA to produce a four dimensional row TDATA. 

N0NLN1, which is called first (and only once), sets parameters for 

i 

N0NLN2. N0NLN1 uses statistics (means and diagonal of covariance matrix) 
on NCLASS classes and the class numbers IW and IG of distinguished classes 
(called "wheat" and "grass" here). N0NLN2 takes input DATA into numbers 
0. to 64. so that input data near wheat will map to TDATA high in channel 
4 and low in channel 1 and 2, and input data near grass will become high 
in channel 1 and low in 2 and 4. With standard color assignments used 
to display ERTS data, wheat becomes red, grass green. 

This method of transforming data is highly nonlinear and is quite 
sensitive to noise in the input data; however, the output color spread 
is spectacular. 

Application . The program was developed for a specific application: 
when multispectral multitemporal data is transformed to lower dimensionality 
using a feature selection program, the transformed data has no intrinsic 
meaning--no "reality." However, the transformed data (if, say, four 
dimensional) should be more managable provided it can be displayed at 
all. The problem is not just the range of the transformed data, or the 
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fact that real data, unlike classes the feature selection program was 
"trained" on, transform wildly; the real problem is the lack of any con- 
sistent relationship in the transformed data. Thus it is easy to produce 
a color display but hard to analyze what the colors mean. Program N0NLN1-2 
attempts to allign the selection of colors so that certain classes have 
certain colors, and this assignment will be relatively independent of 
which feature selection program produced the reduction in dimensionality. 

The program is applicable to raw single pass data. Although wheat 
and grass are probably not separated well enough, other classes are. 

The program should greatly enhance color display of single pass data. 

Source lianquage . FORTRAN IV 100% 

Restrictions . Name N0NLN3 is reserved (the name of a COMMON block). 

If classes IW and IG are too close the transformed data will be noisy 
and lose separation. NCLASS must be at least 3. 

I/O Configuration . Both programs are I/O free. 

Deck Set-up . Job Control Cards 

Calling program* 

N0NLN1 

N0NLN2 

F0LD64 

Job Control Cards 
Data 

*for comments on the calling program, see Usage. 
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Usage. Calling sequence, N0NLN1: 


CALL N0NLN1 
NCLASS 


BMU 

BSBTD 

IW 

IG 


( NCLASS, BMU, BSBTD, IW.IG), where 

number of classes for which training statistics 
are given 

mean vector for each class: , NCLASS by 4 
diagonal elements of covariance matrix: NCLASS by 4 

class to be made red 
class to be made green 


CALL N0NLN2 
DATA 
TDATA 
LDA 


(DATA, TDATA, LDA) , where 
input row, type real, LDA by 4 
output row, type real , LDA by 4 
number of pixels in a row 


Comments on the calling program . The calling program may have a 
general flow as follows: 

1. Set up data set with data to be transformed and transformed 
data (may be the same data set since input is only needed 
once). 

2. Input or otherwise determine parameters for NONLN1. 

3. Call N0NLN1. 

4. Itialize a row counter loop. 

5. Input a row of data. 

6. Convert to type REAL if necessary and store in DATA 

7. Call N0NLN2 . 

8. Store a row of data, packing or converting from type REAL 
if necessary. 


9. 


Next row. 
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Timinq. N0NLN2 is fast, probably faster than whatever I/O and data 
conversions are going on. For each pixel, about five floating point 
multiplications and ten additions, and ten each integer additions and 
multiplications are required. 


Storage Requirements . Approximately 5000 8 bit bytes code for both 
N0NLN1 and N0NLN2; array storage (assuming 32 bit real numbers) will be 
about 4 * (47 + 8 * (NCLASS + LDA) ) 8 bit bytes. 


Possible Extension, Suggestions for Improvements . 

These comments refer to batch operation only. 

1. Suggestion for improving speed: This suggestion is based 

on two observations: first, owing to noise, the transformed 

data need have no more than (say) 64 levels. Second, numbers 
in channel I between S3MIN(I) and S3MAX(I) are mapped into 
numbers 0. to 64. Thus a vector for each channel can be 
set up to map DATA into TDATA by simply computing an index 
and referencing a vector. The following sketch of a program 
shows how this might be done: 

SUBROUTINE N0NLN4(CH1,CH2,CH3,CH4) 

DIMENSION DATA( 100,4) ,TDATA( 1 00,4) , CHI (100) ,CH2(100) ,CH3(100) ,CH4(100) 
C0MM0N/N0NLN3/SIMIN(4) ,S2MAX(4) ,S3MIN(4) ,S3MAX(4) 
get data NCLASS, BMU,BSBTD,IW,IG 
CALL N0NLN1(NCLASS,BMU,BSBTD,IW,IG) 

DO 5 J = 1 ,4 
X = S3MIN(J) 

DX = (S3MAX(J) - S3MIN(J) )/100 
DO 5 I =? 1, 100 
DATA(I,J) = X 
5 X = X + DX 

CALL N0NLN2(DATA, TDATA, 100) 

DO 10 I = 1, 100 
CHI ( I ) = TDATA(I.l) 

CH2(I) = TDATA(I,2) 

CH3(I) = TDATA(I,3) 

CH4(I) = TDATA(I,4) 

RETURN 

END 
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The output of this program could be applied as follows: 

For each pixel: determine if all four values are in range S3MLN 

to S3MAX; if not, set all transformed values 0. If so, set 
transformed value in channel 1 equal to CHl(KX) where 
KX = 1 + (S3MAX(1) - X) * 100 / (S3MAX(1) - S3MIN(1) ) 
and so on for channel 2, 3 and 4. 

2. In a number of important applications the four dimensional data 
will be type INTEGER, perhaps even six or seven bit integers 

(0 to 63 or.O to 127). For instance, the data may have been 
transformed and then scaled and packed; or the data may be one 
pass data. In such a case it is clear that no scaling at all 
is necessary to produce a transformation of the data--only 
larger (perhaps) vectors CHI through CH4. Further, here the 
transformation would most likely be back to integer variables 
anyway, so that CHI through CH4 can be integer vectors. 

3. The last possibility (that the transformation is from integer 
to integer) can be improved even more if the computer has 

a capability similar to the translate under mask instruction of 
the IBM 360/370. Four masks can be set up and a whole row of 
packed data can be translated at once (i.e., in just a few 
microseconds). This would obviously be the way to go if 
it were possible. 

4. Suggestion for testing "tamer" versions: Most of the wildness 

of N0NLN1-2 is caused by the size of fudge factor GWGRN and 
WGRED (see the mathematical documentation and Table 2 for 
definition). For example, with the test data given WGRED 
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is nearly 300 and GWGRN over twice this. (Note, however, 
this only corresponds to a noise amplification factor of a 
little under 5 in the red channel and about 11 for green. The 
blue channel is hardly affected at all by amplification of 
noise since FFBLU is relatively small.) In any case, one 
may be willing to accept less spectacular colors in exchange 
for less noise. One suggestion would be to decrease the number 
64. in the definition of GWGRN and WGRED to, say 32. It 
would probably still turn out that wheat was the reddest thing 
around and grass the greenest. 

5. A restriction of N0NLN1 is that NCLASS > 3. If NCLASS = 2, 
use instead program R0TAT1-2. 

Additional Information . 

Mathematical description: N0NLN1 and N0NLN2 

Table 1. Local variables : N0NLN1 

Table 2. Variables in COMMON block : N0NLN3 

Table 3. Local variables : N0NLN2 

General flow chart : N0NLN1 

General flow chart : N0NLN2 

General flow chart : Test program 

Listing 

Test program and test listing 
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Mathematical Description: N0NLN1 and N0NLN2 

The idea behind this transformation is to force one user-selected 
class to be red and another user-selected class to be green. In the pro- 
gram itself, these classes are referred to as "wheat" and "grass" 
respectively. A third class is selected by the program to be saturated in 
blue. Of course, if the user-selected classes are close together this 
procedure results in a noisy image; worse, unless considerable care is 
taken, much of the original separation will be lost in the transformed 
data. Most of the complication of the program is concerned with preserving 
as much separation as possible. 

Although N0NLN1 is called first to set the program parameters in 
N0NLN2 (which performs the actual transformation), we describe N0NLN2 
first. Program N0NLN1 is easier to understand once the use to which 
the parameters are put is known. 

On each call to N0NLN2, one row DATA of LDA pixels is transformed 
and returned in TDATA. There is no assumption made anywhere that DATA 
consists of (for example) positive numbers, or numbers in any certain 
range. The first task N0NLN2 accomplishes is to examine a pixel and 
decide if it is almost certainly not like any of classes which N0NLN1 
used to define the transformation. This is done by seeing if one of 
the pixel's four coordinates lies outside the largest and smallest 
expected significant value as defined in N0NLN1. In the program this 
value is S3MAX(I) and S3MIN( I ) respectively, I = 1 to 4, and represents 
maximum of mean + 3 sigma over NCLASS classes and minimum of mean - 3 
sigma over NCLASS classes per coordinate. Failure to be acceptable in 
any coordinate results in a zero value in each output coordinate and 
movement to the next pixel. 


- 8 - 


Acceptable data is now mapped into numbers (generally) between 

0 and 1 linearly in each channel by the map y = (x-m)/(M-m) , where 
x is the input coordinate, M is the maximum mean + sigma over 
NCLASS classes, m is the minimum mean - sigma over NCLASS classes, and 
y is the output value. In the program, x and y are both stored in 
DATA, m is SIMIN(I), I = 1 to 4, and l/(M-m) is SIMAX(I), I = 1 to 4. 

The stage is now set for the actual transformation. Let w(i) and 
g(i) denote the transformed means of class IW and IG, i = 1 to 4. (These 
parameters are set by N0NLN1 of course.) Let f denote the function with 
f(64* I) = 0, I even, f (64- 1 ) = 64, I odd and f linear between. Let 

1 , i , i. and i denote the green, red, blue and other channel numbers 

g* r b o 

selected by N0NLN1. The green, red and other channels are straightforward: 
with input x , 


green: y(l) = f ( 64 


red: y(4) = f I 64 


( f 


X(i ) 

9TCT 


x(i r ) 


-W(i 

^gV 


w(i r ) - g( 


g(i r )\ 

w/ 


other: y(3) = f(64 • x(i G » 


For the blue channel, things get a little tricky: let 


:(o, |x(i, 


t = max|0, |x(i b ) 


g(i b ) + w(i b ) w(i b ) - g(i b ) 


Let t^ denote the maximum of t for x ranging over the means of all 


classes. Then 
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blue: y(2) = f (64 • t/t M ) . 

Now we describe the selection of channels i , i 'and i, . As 

r g b 

can be seen immediately, N0NLN2 is a violent mapping if classes IW and 
16 are not well separated. Thus we select for red and green the index 
i’ r with w(i) - g(i) maximum and i the index with maximum remaining 
w(i) - g(i) , i f i . Blue index i fa , on the other hand, is selected 

to be that index with minimum w(i) - g(i) . Once the indices are 
set, simple variables are set equal to the various fudge factors; these 
variables are passed from N0NLN1 to N0NLN2 through named COMMON block 
N0NLN3. 
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TABLE 1 . Local variables : N0NLN1 


I 

DO loop index 

J 

DO loop index 

NCLASS 

Number of classes for which training statistics 
are furnished 

SIG 

Temporary value of standard deviation 

BSBTD(J,I) 

Diagonal of covariance matrix in channel I, class J 

BMU(J,I) 

Mean, channel I, class J 

TEMP 

Temporary real variable used for getting maximum 
or minimum 

W(4) 

Transformed (into unit cube) class IW mean vector 
w(i) in mathematical description 

G{4) 

Transformed class IG mean vector 
g(i) in mathematical description 

WMG(I) 

|w(i) - g(i) | 

XTEMP 

Another temporary real variable 

IW 

Class number of wheat 

IG 

Class number of grass 
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TABLE 2. Variables in COMMON block : N0NLN3 

S 1MI N ( 4 ) 

Minimum over classes of mean in channel I minus 
sigma in channel I, I = 1 ,4 

S1MAX(4) 

1 ./(SIMAX(I) - SIMIN(I)), where SIMAX(I) is first 
set to be the maximum over classes of mean plus 
sigma in channel I. 

S3MIN(4) 

S3MAX(4) 

Minimum (respectively maximum) of mean - 3 sigma 
(respectively mean + 3 sigma) over classes for 
channel I. 

IRED 

Index of red channel i 

r 

IBLUE 

Index of blue channel i* b 

IGRN 

Index of green channel i 

WGRN 

W( V 

GWGRN 

64 . / (w( i r ) - g( i r ) ) 

GWBLU 

(g(i b ) + w(i b ))/2 

GRED 

g(i r ) 

WGRED 

64 . / ( w( i r ) - g(i r )) 

WMGB2 

|w(i b ) - g(i b ) |/2 

FFBLU 

64/ t^ (see the mathematical description for definition 

o f t M ) 

I4TH 

1 0- ( i + i + i ) (Index of other channel) 
' r g n' 



- 12 - 


TABLE 3. Local variables : N0NLN2 


DATA(LDA,4) 

TDATA(LDA,4) 

LDA 

IPT 

ICHNL 

TEMP 


One row of four dimensional real data to be transformed 

The transformed data 

Number of pixels per row 

DO loop index — pixel numbers 

DO loop index--channel number 

Temporary real variable 
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GENERHL FLOW CHRRT •* KIDNLN I 
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(strrt) 


/ RERD MERN5 
RN& D I RG0NRL5 
OF COVHRIRNCE 
MRTRICE5 


/ RERD CLR55 
NUMBERS FOR 
WHERT RND GRR55I 



(stop ) 


GENERRL FLOW CHRRT : TEST NDNLN 1 / N0NLN2 






o n n n n r> n n o r> n r> <> n n n »» A »> 0 n 
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subroutine NCKLM (NCLASS. BMU, ESeTC. IW, IG) 

FUNCTION - TO SET PARAMETERS FOR SUBROUTINE N0NLN2 
USAGE -CALL NC NL M < NCL ASS . EMU. ES 8TD. IW, 1G > 

PARAMETERS - 

NCL ASS - NUMBER OF CLASSES FOR WHICH TRAINING STATISTICS EXIST 

BMU - MEAN VECTCR FOR EACH CLASS: NCL ASS ET 4 

ESBTC - DIAGONAL ELEMENTS OF COVARIANCE MAT R I >J NCLASS BY 4 
IW - CLASS NUMBER )F CLASS TO BE MADE RED 

IG - CLASS NUMBER OF CLASS TO BE WADE GREEN 

PRECISION - SINGLE 

RECO. RTNS.- NONE (SINGLE PUR ROSE — C ALLED BEFORE NONLN 2 ) 

RFSTRICTI ON S 

NONLN 3 - A RESERVFO NAME OF A COMMON BLOCK 

NCL ASS - MUST RE AT LEAST 3 
LANGUAGE - FORTRAN IV 

SUBROUTINE NCNLM ( NCL ASS . BMU, ES ET C« IW. IG) 

DIMENSION BMU NCLASS ,4) ,BSB TO ( NC LASS ,4 ) • W (4 ) .G ( 4 ) , W NG ( 4 ) 

C ONCN/ NONLN 3/SIM IN (4 ), S IMAXC 4 ). S3MIN( 4> • S3mA X< 4) , I RED, I BLUE . 

4 IGRN, WGR N, GWG RN .GW BLU .GRED.W CRED. W MGB2. FF ELU, I 4T H 

FINO FUDGE FACTORS FOR CUBE 

00 40 1=1,4 

S I M IN< I )= BMU (1 , I )-SQRT( BSBTD< 1,1)) 

S1MAX (I ) =S1 MIN( I) 

S 3M I N ( I ) = BMU(l,I)-3* SO R T ( 3 SB TD ( 1 .1 ) ) 

S3 MAX (I ) = S3M IN ( I ) 

DO 4 C J=! .NCLASS 
SIG=SORT( BSB TD( J, I ) ) 

T EMP= RMU ( J , I )— S IG 

1 F( TEMP, 3 T. SI MI NCI )) GO TO 50 
SIM IN ( I )=TEMP 

50 T£WP=BMU( I )+S IG 

I F( TE MP,L T. S IMAX( I) ) GO TO 41 
SI MAX ( T )= TEMP 
4 1 TEMP=BMU( J ,1 )-3* SIG 

IF( TEMP, 3 T. S3MI N( I ) ) GO TO 42 
S3 M IN (I )=T EMP 
42 TEMP =0 Mu( « » I ) +3 *S I G 

I F( TEMP.L T ,S 3MA X( I ) )GO TO 4 0 
S3 MAX ( I )= TEMP 
40 CONTINUE 
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FOR EFFICIENCY REPLACE FUDGE D I VI £1 CN 0Y MULTIPLICATION 
DO 45 1=1 ,4 

AS SIMA X< I )= I. /( S1MAX( I) -SIM INI I > ) 

NORMALIZE wheat and gfass means and find W<I)-G<I) 

C 

DC 60 1=1,4 

W( I ) =(BMU( IW,I >-Sl MI Nil ) )*S1 MAX ( I ) 

G( I )= (RMUI IG, I )-S 1MINI I )> AS IMA XI I ) 

60 HMG (I ) =ABS (W( I )-G( I) ) 

C FIND RED CHANNEL 

C 

TEMP = VlMGI 1 ) 

01 70 1=1,4 

IF (T EMP. GT .WM G( I ) ) CD TO 70 
TEMP =WMG ( I ) 

IRED= I 

70 CDNT INUE 
C 

C FIND BLUE CHANNEL 

C 

DO 80 I =1 ,4 
IF( I .EQ.IREDIGO TO 80 
IFIWMGI 1 ) ,GT .TEMP )G0 TO 80 
TEMP = WMG(I) 

I BLUE —l 
00 CONT INUE 
C 

C FIND GREEN CHANNEL 

C 

DC 90 1 = 1 , 4 

IE I I.EQ* IRED1GO TO 90 

IF( l ,EQ , IBLUE 1GO TQ 90 

IF (TEMP, GT , W MG I I))GC TO 90 

TEMP=WMG< I ) 

I GRN= I 
90 CCNTINUE 

r- 

L- 

C ASSIGN FOURTH CHANNEL 

C. 

I 4 TH= 10-1 REO-I BLUE- IGRn 
C 

C ASSIGN A FEW CONSTANTS 

c . 

W CRN= W( IGRN ) 

GW0LU= I G I I ELUE ) *W < IRLU E ) )/ 2 . 

GRED=G( IRED) 

GWCRN=64 ./( G( IGRN )-W( IGRN) ) 

WGRED=64 ,/ (W I I RED) -G< IRED)) 
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c 

C FINO REMAINING CLASS WITH LARGEST CCMFCNENT AW AY 

C FROM THE mean OF WHEAT AND GRASS 

c 

TF MP=GwOLU 

CO 100 1= l.NCLA SS 

IF { I .EC . Iw .OR . I . EO . IG 5G0 TO 100 

XTEMP=ARS( (OMU( I , IRLUE ) -S 1 MIN(I0LUE))*S 1 M AX (I ELJE )-GW ELU ) 
I F( XTFMP ,LT .TEMP )G 0 TO 100 
TEM F=X TFMP 
100 CONTINUE 
C 

C NCW FINO THE S.UE FUDGE FACTOR 

C 

WMGB2=WMG< IBLUE )/2. 

FFBLJ = 5A . / ( AES CT EMP-WM C82 ) > 

RETURN 
EN 0 
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c 

c 


SLBRCUTI NF 

function 


USA GF 

F A F fi M FT £ FS 
DATA 
TO A TA 
L C A 

F RFC IS I CN 
RFQD. RTNS. 


NCNLN2 (0 AT A .TO AT A t LD A ) 

- TO TRANSFORM FOUR DIMENSIONAL REAL DATA A FCW AT A 

TIME TO ANOTHER REAL ROW OF FOUR DIMENSIONAL DATA 
IN THE RANGE 3.-64. ATTEMPTING TO MAKE CLASS IW 
RED (HIGH IN CHANNEL 4 * LOW IN 1 AND 2) AND CLASS 
IG GREEN (HIGH IN CHANNEL 1* LOW IN 2 AND 4). 

- CALL NCNLN2(DATA,TDATA,LDA) 

- ONE RCW CF FCUR DIMENSIONAL REAL DATA: LD A BY 4 

- THE TRANSFORMED DATA! LD A BY 4 

- THE NUMBER OF PIXELS IN A ROW 

- S IN GL E 

- N0NLN1 MUST BE CALLED TC SET FFOGRAM VARIABLES 
FUNCTION F OLD 64 IS REFERENCED 


RESTRICTIONS 

NONLN3 - A RF SERVED NAME OF A COMMON BLOCK 
LANGUAGE - FORTRAN IV 


SUBROUTI NE NQNLN 2 ( C AT A, T OA T A ♦ LD A ) 

DIMENSION C AT A (L CA, 4 ) , TOATA( LDA , 4 ) 

C CMMCN/NCNLN3 / SI M I M4 ) ,S1 MAX (4 ) ,S 3 M I N ( 4 ) , S 3M AX (4 ), IRE C, I BL U E. 

* I GRN . WGRN . G WGR N »G W3 L L .G RED * WG RE D ,W MGB2 , F FBL U* 14 TH 


COMPRESS CA1A INTO CUeE 

DO 130 IPNT=1,L CA 
DO 1 32 ICHNL=1 .4 
TEMP= D A TA (IPNTi I CH NL ) 

IE(TEMP.GT .S3M Ax < ICHNL ) .OR .TEMP .L T .S 3M INC ICHNL) )G0 TO 145 
132 CONTINUF 

CO 136 IC HNL =1 .4 

136 DA 74 ( I PNT . I CHNL ) = ( DAT A< I F NT * ICHNL ) -SIM IN ( ICHNL > ) *SIMA X( ICHNL) 
1 38 CON TI NUE 

c 

C MOVE OATA TO TRANSFORM ARRAY. DOING TRANSFORMATION 


T CA T A ( IPNT, 1 )=FOLO C4( ( DA TA ( I PN 1, IGRN) - WGRN) *GWGRN) 
TDAT A ( I PNT. 3 )= EOL C64< CAT A{ IPNT, I4THM64.) 

TO A TA ( IPN T.4 ) =F CLD64 ( (DATA ( IPNT ,IREC>-GREC)*WGRE0) 
T EMP= ABS ( CAT At I^NT , I BLUE ) -G WBL U ) - WMGB 2 
IF( TFMP .LT .0 .ITEM F=0 . 

TDA TA ( I PNT, 2) =F OLD 64 ( TEMP* FFBL L ) 

CC T C I 30 

1 45 DO 145 I =1 .4 

146 TOA TA ( I PN T, I ) = 0. 

130 CONTINUE 

RETURN 

END 
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c 

c 

c 

c 

c 


c 

c 

c 

c 

c 

c 


fun: t ion 


TO MAP A REAL NUMBER IMC ONE BETWEEN 0. AND 64. 
ev " FOL C IN C" RATHER THAN CLIPPING 


USAGE - 

parameters - 

X - 

Y - 


R ESTR ICT ION S 

PRECISION - 
L £N GU ACE - 


Y =FOLD 6 4 ( X) 

ANY REAL NLMBER 

THE RFSLLTANT BETWEEN C. A NO 64. Y IS CONGRUENT TO 
X (MOC 64) IF X IS IN AN INTERVAL < 6 4 * I • £ 4* ( I + 1 ) ) 

WITH I EVEN; OTHERWISE Y IS CONGRUENT TO 64-X (MOD 64) 
NONE 

X SHOULD NOT BE TOO LARGE OR EFFICIENCY SUFFERS 
SI NGLE 
FORTRAN IV 


FUNCTION FOL 064 ( X ) 

FOL 06 4 = A B S( X ) 

IF { F0LD64 .LE .64 . ) RETU RN 
1 FOLD 64=A3 SI FOLD 6 4-128. ) 
IF( F0L064 .GT .64 . )GOTO l 
RETURN 
END 
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COMPUTER PROGRAM DOCUMENTATION 


Program ROTAT1 and ROTAT2 

Rotation to Produce Color Displays 

Abstract . These programs together perform a transformation of four 
dimensional real row DATA to produce a four dimensional row TDATA. 

R0TAT1 , which is called first (and only once), sets parameters for 
R0TAT2. R0TAT1 uses statistics (means and diagonals of covariance matrices) 
on NCLASS classes and the class numbers IW and IG of distinguished classes 
(called "wheat" and "grass" here). R0TAT2 takes input DATA into numbers 0. 
to 64. so that input data near wheat will map to TDATA high in channel 1 
and low in channel 2 and 4, and input data near grass maps to data with 
more channel 2 and low in channel 4. With standard color assignments used 
to display ERTS data, wheat becomes a saturated red, grass orange or 
perhaps yellow. 

This method of transforming data is nearly linear and is insensitive 
to noise in the input data; however, the output color spread is not 
spectacular. Only two classes need be trained on. 

Appl i cation . The program was developed for a specific application: when 

multispectral multitemporal data is transformed to lower dimensionality 
using a feature selection program, the transformed data has no intrinsic 
meaning--no "reality." However, the transformed data (if, say, four 
dimensional) should be more managable provided it can be displayed at all. 
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The problem is not just the range of the transformed data, or the fact 
that real data, unlike classes the feature selection program was "trained" 
on, transform wildly; the real problem is the lack of any consistent 
relationship in the transformed data. Thus it is easy to produce a color 
display but hard to analyze what the colors mean. This program attempts 
to allign the selection of colors so that certain classes have certain 
colors, and this assignment will be relatively independent of which feature 
selection program produced the reduction in dimensionality. 

This program is applicable to raw single pass data. Even confused 
classes (as, for example, wheat and grass are likely to be) can be 
displayed with some enhancement of their separation. 

Source Language . FORTRAN IV 100% 

Restrictions . Name R0TAT3 is reserved (the name of a common block). 

If the wheat vector points to the "middle" of four dimensional data some 
separation may be lost. 

I/O Configuration . Both programs are I/O free. 

Deck Set-up . Job Control Cards 

Calling program* 

R0TAT1 

R0TAT2 

F0LD64 

Job Control Cards 
Data 

*for comments on the calling program, see Usage. 
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Usage . Calling sequence, R0TAT1 

CALL ROTATl(NCLASS,BMU,BSBTD,IW,IG) , where 

NCLASS number of classes for which training statistics 

are given 

BMU mean vector for each class: NCLASS by 4 

BSBTD diagonal elements of covariance matrix: NCLASS by 4 

IW class to be made red 

IG class to be made yellow 

Calling sequence, R0TAT2 
CALL R0TAT2( DATA,TDATA,LDA) , where 
DATA input row, type real, LDA by 4 

TDATA output row, type real, LDA by 4 

LDA number of pixels in a row 

Comments on the calling program . The call ing program may have a 
general flow as follows: 

1. Set up data set with data to be transformed and transformed 
data (may be the same data set since input is only needed 
once) . 

2. Input or otherwise determine parameters for R0TAT1. 

3. Call R0TAT1. 

4. Intialize a row counter loop. 

5. Input a row of data. 

6. Convert to type REAL if necessary and store in DATA. 

7. Call R0TAT2. 

8. Store a row of data, packing or converting from type REAL 
if necessary. 


9. 


Next row. 
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Timing . R0TAT2 crunches numbers; for each pixel, about 25 each fixed 
point additions and multiplications, 24 floating point additions and 
20 floating point multiplications are required. 

Storage Requirements. Approximately 7000 8 bit bytes code for both 
R0TAT1 and R0TAT2; array storage (assuming 32 bit real numbers) will be 
about 4 * (91 + 8 * (NCLASS + LDA)) 8 bit bytes. Exact storage require- 
ments will depend on computer type. 

Possible Extensions, Suggestions for Improvements . 

1. As can be readily seen from the example, the blue channel 
has maximum value less than 0.5 in each of the six classes. 

This may be acceptable; however, should the user wish, this 
is easily adjusted by the following changes in R0TAT1: 

Change to 

C(3,2) = -C (2,3) C(3,2) = -2.*C(2,3) 

C(3,3) = C(2,2) C(3, 3) = 2<*C(2,2) . 

2. A similar change can be made in the red channel so that wheat 
will be pure red; this will not be as violent as the map in 
N0NLN1. The change is 

C(l,l) = 1. to C(l,l) = 1./WN0RM. 

The effect of these two changes is displayed in the mathematical 
description of R0TAT1-2. Changes 1 and 2 have been made in 
the version of R0TAT1 delivered. 

3. R0TAT2 can be speeded up at some cost in complication. This 
amounts to writing out the loop which performs the multiplication 
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of a vector of data by E. The reason it will be faster 
is that the current version uses 16 references to array E and 
16 floating point multiplications while actually E is 
zero in 6 of these places. This change would probably 
speed up R0TAT2 by 40 percent. 

Additional Information . 

Mathematical description: R0TAT1 and R0TAT2 

Table 1. Local variables: R0TAT1 

Table 2. Variables in COMMON block: R0TAT3 

Table 3. Local variables: R0TAT2 

General flow chart: R0TAT1 

General flow chart: R0TAT2 

General flow chart: Test program 

Listing 

Test program and test listing 
Mathematical description: R0TAT1 and R0TAT2 

The idea behind this transformation is to align the color display in 
a reproducible fashion while maintaining the original geometric relation- 
ships. Since this is generally not possible, the program introduces mild 
nonlinearities. 

Program R0TAT1 defines the transformation; R0TAT2 applies it to one 
row of data at a time. There is no assumption made anywhere that the 
input data has any certain range. ROTAT first examines a pixel and 
decides if one of its four coordinates is out of the interval 
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(S3MIN( I ) ,S3MAX( I ) ) , I = 1 to 4 , the minimum and maximum of mean 
+ 3 sigma over NCLASS classes per coordinate. Failure of any coordinate 
to lie in the interval results in a zero output in each coordinate and 
movement to the next pixel. 

Acceptable data is now mapped into numbers which are generally 
between 0 and 1 in each coordinate by the map y = (x-m)/(M-m) , 
where x is the input coordinate, M is the maximum mean + sigma over 
NCLASS classes, m is the minimum mean - sigma over NCLASS classes, 
and y is the output value. Depending on a parameter supplied by 
R0TAT1, either y or -1 + y is stored. (We will see this has the 
effect of complementing data in that coordinate.) 

If Y denotes the 4-vector of data at this point, the transfor- 
mation X = E Y is applied; E is a 4x4 matrix which is a permutation 
of 64 times the product of two rotations, described in detail below. 
Output X is now folded by the scalar function f with f (64 - 1 ) = 0 , 

I an even integer, f(64*I) = 64, I an odd integer and f linear 
between. R0TAT2 goes to the next pixel and returns when LDA pixels 
have been transformed. 

We now describe R0TAT1 which supplies all these parameters. R0TAT1 
first examines the NCLASS means and variances in each coordinate to 
determine S1MAX,S1MIN,S3MAX and S3MIN— the maximum and minimum of 
mean + sigma and mean + 3 sigma over all classes in each coordinate. 

The program then transforms means for wheat and grass into the unit 
4-cube and selects three of the four indices as follows: 
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i is selected to maximize the separation of wheat and grass 

i is selected to next maximize the separation of wheat and grass 

i b is selected to minimize the separation of wheat and 
grass 

ig is the other coordinate index. 

Thus, if w and g denote the images of wheat and grass in the unit 
4-cube, we have 

|w(i b )-g(i b ) |<|w(i 0 )-g(i 0 ) |<|w(i g )-g(i g ) | < | w( i r ) -g ( i f ) | . 

The program examines w(i r ) , w(i g ) and w(i* b ) as follows: 

If w(i ) < 0.5, complement data in coordinate i f ; that is, replace 

a transformed value x( i r ) by 1 - x(i r ) . Similarly, complement 

data in coordinate i when w(i ) > 0.5 and complement data in coordinate 

g g 

i b when w(i b ) > 0.5. If g(i g ) < g(i b ) > interchange coordinates i g 

and i b . Fig. 1 depicts the result of performing these transformations to 

test program data; 1 is grass and 5 is wheat. Note that 5 is as near 
the 1 axis as it is possible to make it with this kind of mapping. 

Now move the transformed vector 5 (which we again denote by w) 

to lie on the i -axis by first rotating into the i - i. plane about 
r r b 

the i b axis and then onto the i r axis by rotating about the 1 
axis. If w r = w(i r ) , w g = w(i g ) and = w(i b ) , then this mapping 
is given by 
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where w - /(w* + w* + w §) and v = ^( w g + w£). Figure 2 shows the 

result of applying A to the six mean vectors and then plotting the absolute 
value of each coordinate. For our data. 


A = 


.828 

.394 

.399 

-.561 

.581 

.589 

0 

-712 

.702 


\ 

/ 


Next the data is rotated about the i axis so that the transformed 

r 

g vector will lie in the i f - ig plane. This rotation is given by 



where n = 4g(ig) 2 + g( i b ) 2 ) and g denotes the transformed grass vector. 
In our test data, g( i b ) is very small, so that this transformation does 


not do much. We have 
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/l 


C = 


0 

0 


0 

.999 

.036 


0 

-.036 

-.999 


The product of C and A maps mean vectors as shown in Fig. 3 (with 


absolute values taken). 

We 

have 


00 

CM 

00 

• 

.394 

.399 \ 

CA = 

.561 

.556 

-.614 


1 -.020 

.732 

-.681 i 


Before continuing our description of R0TAT1, we comment on suggested 
changes (change 1 and 2): Note that the wheat vector Is not as large 

as grass, even in coordinate i . If (this is change 2) C(l,l) is 

replaced by l/||w|| , then we obtain the result shown in Fig. 4. (All 
discussion from now on refers to plots of folded (rather than clipped) 
vectors. This is exactly what program R0TAT2 does.) Necessarily, 

| | w | | > j ; it follows that the noise should not be amplified very much 

by this change. 

In Fig. 5 we display the affect of change 1 only, and Fig. 6 the 
effect of both changes. Since these changes make the transformation 
less accurate geometrically, they have the potential to degrade separa- 
tion and amplify noise. We therefore generated and plotted random data 
with statistics like those used as input to N0NLN1 and plotted (for 
comparison) the effect of changes 1 and 2. Some of this is presented 
here. Fig. 7 shows wheat and grass random vectors as transformed by 
the unchanged method; Fig. 8 shows the same data under change 1 and 2. 
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(The line segments are drawn from the point in 3-space to the nearest 
coordinate plane.) In Fig. 9, the upper plot shows all six classes after 
change 1 and 2. The lower plot shows the original method. (Twenty points 
in each class may have been too many; the plot is somewhat confusing.) 

As a result of these and other studies we have decided to deliver 
the version of N0NLN1 with change 1 and 2 implemented. Final decision 
which version to use will have to be based on actual real data as viewed 
in color. 

Returning to the description of N0NLN1, a matrix E is defined 
which is a permutation of the matrix 

0 

/ 

4x4 

i goes to channel 4, i to channel 1, i. to 
r g b 

channel 2 and ig to channel 3. Also, a multiplication of +64 is 
performed to each row (depending on whether that row is complemented). 



so that coordinate 
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Fig. 1. Coordinates i . i\ and i, of scaled 

r g b 

and complemented row mean vectors. 
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3 


Fig. 3. Absolute value of transformation of 
Fig. 2 by C. 


f 
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1 


Fig. 4. Change 2 applied to C to make WHEAT redder. 
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Fig. 5. Change 1 applied to C to increase spread in blue channel. 


A 
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Fig. 6. Change 1 and 2. 
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Fig. 8. Random data, change 1 and 2. 



2, six classes, 
classes. 
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I 

J 

NCLASS 

SIG 

BSBTD( J ,1) 
BMU(J, I) 
TEMP 

IW 

IG 

6 ( 1 , 1 ) 

6 ( 1 , 2 ) 

W(I,1) 

W(I,2) 

K1 

LI 


K2 

L2 

K3 

L3 

K4 

XL(4)* 


TABLE 1. Local Variables : N0NLN1 

DO loop index 
DO loop index 

Number of classes for which training statistics are 
furnished 

Temporary value of standard deviation 

Diagonal of covariance matrix in channel I, class J 

Mean, channel I, class J 

Temporary real variable used for getting maximum or 
minimum 

Class number of wheat 
Class number of grass 
Image in unit cube of grass mean vector 
1 - 6 ( 1 , 1 ) 

Image in unit cube of wheat mean vector 
1 - W(I,1) 

Index i r 

A flag : LI = 1, do not complement in class K1 
L2 = 2, do complement in class K1 

Index ig 

Complement flag for class K2 
Index i b 

Complement flag for class K3 
10 - (K1+K2+K3) 

XL(K1) = 1 - LI ; XL(K2) = 1 - L2 ; XL(K3) = 1 - L3 
L X ( K4 ) = 0 . 
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TABLE 1. (Continued) 


WNORM 

W23 

A( 3 , 3) 

GH(3) 

G23 

C(3,3) 

0(4,4) 


E(4,4)* 


v 

The first transformation 

The transformed by A of the grass vector 

^(gdg ) 2 + g(i b ) 2 ) 

The rotation about i to annihilate the 3 component 
of GH. 



A permutation of D to give standard colors, taking 
into account K1-K4 . 


* These variables in COMMON block R0TAT3 
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TABLE 2. Variables in COMMON block : ROTAT3 


S1MIN(4) 

S1MAX(4) 

S3MIN(4) 

S3MAX(4) 

XL(4) 

E(4,4) 


Minimum over classes of mean in channel I minus 
sigma in channel I, I = 1,4 

1./(S1MAX(I) - SIMIN(I)), where SIMAX(I) is first 
set to be the maximum over classes of mean plus 
sigma in channel I. 

Minimum (respectively maximum) of mean - 3 sigma 
(respectively mean + 3 sigma) over classes for 
channel I. 

Vector used in complementing data 
Matrix used to perform transformation 
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TABLE 3. Local Variables : R0TAT2 


DATA(LDA,4) 

TDATA(LDA,4) 

LDA 

IPT 

ICHNL 

TEMP 


One row of four dimensional real data to be transformed 

The transformed data 

Number of pixels per row 

DO loop index--pixel numbers 

DO loop index--channel number 

Temporary real variable 

Temporary real variable used to generate vector-matrix 
product 


SUM 
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GETNFRRL FLOW CHRRT 5 ROTRT1 
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GENCRHL F*LDW CHHRT : ROTRTI 
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BCNCRHL FT-OW CHHRT*. TEST RDTRT l / R0THT2 





r> n «» 
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c 

c 

c 

c 

r» 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


subroutine rotati (n class. b mu. bsbtd. iw. i« > 


FUNCT ION 
USAGE 

PARAMETERS - 
NCLASS 
BMU 
ESBTD 

IM 

IG 

PRECISION 
RECO. RTNS.- 
RE STRI CTf ON S 
ROT AT 3 
LANGUAGE 


TO SET PARAMETERS FOR SUBROUTINE ROTAT2 
CALL RCT AT 1 < NCLASS, EMU, BS8T0. IM, 1G ) 

NUMBER OF CLASSES FOR WHICH TRAINING STATISTICS EXIST 

(WEAN VECTCR FOR EACH CLASS: NCLASS EY 4 

DIAGONAL ELEMENTS OF COVARIANCE MATRIX: NCLASS eY 4 

CLASS NUMBER OF CLASS TO BE MADE RED 

CLASS NUMBER OF CLASS TO BE MACE Y ELL OW « GR E EN 

S IN GLE 

NONE (SINGLE »UR ROSE «C ALLE3 BEFORE ROTAT2) 

A RESERVED NAME OF A COMMON BLOCK 
FORTRAN IV 


SU EROUT INE ROT AT 1< NCL ASS, BMU, B SB TD . 1G ,1 W) 

D l ME NS I ON BMJ < NCL ASS, 4 ), BS BT D (N CL ASS, 4 > • W( 4 , 2 ), G< 4, 2 1 ,A< 3, 3) , 

$ 3H( 3) ,D< 4, 4) ,C ( 3, 31 

C C MM CN / ROT AT3/S1M INI 4 ) , S 1MAX( A ), S3MIN( 4) , S3MAX( 4) , XL < 4) ,E ( 4 .4 > 


FIND FUDGE FACTORS FOR CUBE 


OO 10 I =1 ,4 

StMINf I ) = BMU( 1*1 ) -SQRT(BSBTOn . l> * 

S I M AX ( I )= S 1 M IN ( I I 

S3MINII J=e*J<l , I ) “3 * S C FT < BS ETC(1 , I) ) 
S3MA X( I )= S3MINI I ) 

DO 10 J=1 ,N CL ASS 
SI G=SQRT( BSBTDI J, I ) ) 

T EMP=BMU( J, I l-SIG 
IFITEMP.GT .S IM IN < I ) ) GO TO 20 
SIMINI I ) =TEMP 
20 T EMP=BMU( J , I J+S IG 

IF (TEMP.LT ,S I MAX ( I ) ) GC T O 12 
SIMA XU )= TEMP 
12 T EMP=BMU< J, I >-3 *SIG 

IF ( TEMP. GT.S3MIM I »|GC TC 14 
S3MINI I 1= TEMP 

14 T EMP=BMU (J, I > + 3*S I C 
IFITEMP.LT. S3 VAX( I) )GC TO 10 
S3M AX( I ) — TEMP 

10 CCNTTNUE 

DO 1 5 I =1 .4 

15 S IM AX< I |= 1 ./< S1MAX( I 1-S1MINI I )) 
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c 

C ^ C R ^ aL I 7.F. WHEAT ANT GRASS MEANS 

CO 30 I = 1 , 4 

G ( I . 1 1= (9MU ( IG, I )*»S 1 M IN ( I ) ) *S 1MAX( I ) 

W( I <1 ) = (BMU IV*. I )- SI M IN( I ) ) *S 1 >»AX ( I ) 

W( 1*2 )=1 *0-W( I . 1 ) 

30 G( I *2 ) =1 .0-G( I .1 ) 

C 

F IN D K 1 AND L 1 

TEMP= 0.0 
CO 40 1=1 .4 

IF ( TEMP .GT. ABS ( C( I. 1 )-W ( I. 1 ) ) I GO TO 40 

TEMP = A3 S( G< I . 1) - to( I , 1 ) ) 

K 1 = I 
40 CONTINUE 
LI = I 

I F( W(Kl.l) ,LT. 0.6 ) LI = 2 

XL ( K1 ) = I - LI 

C 

C FIND K 2 AND L2 

C 

temp = 0. 0 

nc so 1= l « 4 

I F ( I ,EO. K1 ) GC T C SO 

IP ( TE MO ,GT. ABS(G( I , I )-W( I ,1 ) » ) GO TO 50 

TEMP = ABS (G ( I » 1 )— W ( 1. 1 ) ) 

K2 = I 

50 CONTINUE 
L2 = 1 

IF C W( K2 *1 ) .GT. 0.5 > L2 = 2 

XL < K 2 ) = l - L 2 
C 

C FIND K3 4 ^ L3 

T EMP = p . 

DO 60 I =1 .4 

IF ( I ,EQ. K 1 .OP. I .EO. K2 ) GO TO 60 

IF ( TEMP ,LT, AES ( C( I. 1 ) - V# ( I. 1 ) ) ) GO TO 60 

TEMP = AHS(G( 1,1 ) - to(I*l ) ) 

K3 = I 

60 CCNTINUE 
L 3 = 1 

IF (WIK3.1I .GT. 0.5 ) L3 = 2 
XL ( K3 ) =1 - L3 
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r I c THE 2 CCMPONENT CE GFASS IS SMALLER THAN T t- E 3 COMPONENT, 

C THBsl SWITCH THE 2 AND .3 INDICES 

C 

IF(6(K2,L2).GT.G(K3.L3)) GO TO 70 

r=K2 

K2 = K3 

K3 = I 

I =L 2 

L2=L 3 

L3 =1 

TF MP= XL ( K 3) 

XL (K3 >= XL <K 2 ) 

X L ( K2) =TEMP 
C 

CD MPUTE A MATR I X 

7 0 WNGRM*SORT( W (K l.LU**2+W(K? ,L? ) ♦♦2+ » (K3 ,L3 ) **2 ) 

W 2 3=S QRT (w (K 2. L 2 ) * *?. +W(K 3.L 3 )* *2 ) 

A( 1 .1) =W( K1 ,L1 ) /WHCKW 
A(1,2I = W(K2,L2) /WNORM 
A (1 .3 ) =W( *3 « L3 ) /W N C FM 
A ( 2 « 1 ) = «W 2 2/WNORM 

A<2.2) = W (K1 .LI )*W(K2iL2)/(w23W NORM I 
A( 2,3) =W( K1 .LI )*W( K3 , L3 )/( *23 *WNORM> 

A (3. 1 >= 0. 

A (3.2 > = -W (K 3 3 )/W 23 

A ( 3 , 3 1 = W ( K2 ,L2 ) /W23 
C 

C DC THE A POTATION ON THE GRASS VECTOR 

C 

DO 80 1= 1 , 3 

80 GH(I)=G(K1 .LI » * A( I . I > 4G (K2. L2 ) * A ( I. 2 ) +G(K 3, L 3 )*A( 1,3) 

C GET T HE C MATRIX FROM THE ROTATED GRASS VECTOR 

C 

G23=SQRT( GH ( 2 ) * * 2+GH ( 2 ) ** 2) 

C (1 , I )= 1 .O/WNORM 

C(l *2» =C. 

C< 1.31 = 0. 

C<2.1 1=0 . 

C( 2,21= GH( 2 ) /S 23 
CC2.3 1= GH( 3 )/G23 
C(3 .1 ) =0 . 

C( 3. 2)=-C { 2, 3) * 2. 0 
C( 3,3 >=C (2, 2 ) 42 .0 
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c 

C FCFM the e t g c matrix 

c 

03 90 1= t , 3 

0(4,1 ) = 0 . 

0( I .4) = C. 

CO 90 J= 1, 3 
TEMP=0 . 

DO 1 no L = 1 ,3 

100 TEMP=TFM3 <C( I,L MAIL. J) 

90 D( I . J) -TFMP 
D( 4*4)=1. 

C 

C MOVE f. TO E SWITCH IhG COLUMNS 

K4 = 10-K 1-K2-K3 
XL ( K4 ) =9 . 

DO 110 1=1,4 

E( l.K 1 )=6 4 .40 ( I , t ) *( (-1. ) **{ 1 +L 1) ) 

E( I ,K2> =64 ,*0< 1,2 >*( (-1 . >** (1 +L2 > > 

F ( I ,K 3)=6 4.*OC I , 3) *( <«l . >**< 1 H-L3 ) ) 

110 E< I,K4 1=0 (I, 4) *64 . 

C SWITCH ROWS TO STANDARD IMAGE 100 COLORS 

C 

DO 12 C I =1 .4 
TCMP = E (1,1) 

DC 130 J= 1 , 3 
JJ= Jf 1 

1 30 F (J, I )= E< JJ, I ) 

120 F. (4 , I ) = TFMP 
RETURN 
EM D 



u u y u u u u 


- 32 - 


c 

C SU 8 P CU T I NE POT FT 2 ( C AT A ,T DAT A , LDA ) 

C FUNCTION - TO TRANSFORM FOUR DIMENSIONAL PE AL C AT A A ROW AT A 

C TIME TO ANOTHER REAL ROW OF FOUR DIMENSIONAL DATA 

C IN T HP RANGE 0.-64. ATTEMPTING TO MAKF CLASS Tv 

C RED (HIGH IN CHANNEL 4, LOW IN 1 AND 2) AND CLASS 

C IG CREEN (UGH IN CHANNEL 1. LOW IN 2 AND 4). 

C USAGE - CALL PCTAT? (DAT A »T CAT A. LDA) 

C PARAMETERS - 

C DATA - ONE ROW OE FOUR DIMENSIONAL RE Ai_ DATA: LDA BY 4 

C TO AT A - THE TRANSFORMED CAT A : LDA BY 4 

C LCA - THE NUMBER OF PIXELS IN A ROW 

C PREC IS ION - SINGLE 

C RFOD. RTNS. - RO TA T 1 MUST BE CALLED TC SET PROGRAM VARIABLES 
C FUNCTION FOLD 64 IS REFERENCED 

RF STRI CTI ONS 

POTATO - A RFSERVFD NAME OF A CCWWON BLOCK 
LANGUAGE - FORTRAN IV 

SUB ROUT! NF ROT AT?(CATA» TOATA.LDA ) 

C CMMCN / ROT AT 7/S 1M IN( 41.S1MAXI 4 ) . S 3M I N ( 4 > , S 3MA X( 4) , XL < 4) ,F ( 4 ,4 ) 
DIMENSION CATA(LCA,4) ,T 1*. AT A ( LO A ,4 ) 

LOG I CAL TEMP 

COMPRESS CATA INTC CUEE 

DO 170 IPNT= t.LCA 
L TEMP=. TRUE. 

DO 172 ICHNL=1, 4 
T EMP=D AT « ( IPNT , I CHNL) 

IF ( TEMP. GT .ST NAX( ICHNL ) .OP .T EMP . LT .S 3M IN( IC HNL ) >GO TO 176 
172 CONTINUE 

DC 178 ICHNL = 1 , 4 

178 D ATA( IPNT . IC HNL ) =XL( ICHNL)* (DATAIIPNT . I C H NL ) -S 1 M I N ( ICHN_ ) ) 
S*S1MAX< IC HNL ) 

LTEMP = • F ALS F . 

1 7F CONTI NUE 

C 

C DC TRANSFORMATION 

C 

CO 180 IC HNL = 1*4 
SUM =0 • 

IF( LTEMP) GO TO 160 
DD 185 1=1.4 

105 SCM=SUM+ E< I CHNL , I >*DAT A ( IPNT, l) 

C 

C PUT DATA INTO RANGE 0-64 

C 

180 T DATA ( IPNT, I CHNL )=FO_ C6 4(SUM ) 

170 CONTINUE 
R ETURN 
END 
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c 

c 

c 

G 

C 

c 

c 

c 

c 

c 

*■* 

w 

c 

c 

c 


Purer ion 

USAGE 


- TO MAP A REAL NUMBER INTC CNE BETWEEN 0. AND 64 , 

BY "POLO IN O' RATHER THAN CLIPPING 

- Y=F 0L06 4 ( X ) 


PARAMETERS - 

X - 

Y - 


R ESTR ICT IONS 

PRECISION - 
LANGUAGE 


ANY REAL NUMBER 

THE RESULTANT BETWEEN 0. AND £4. Y IS CONGRUENT TO 
X ( M CD 64) IF X IS IN AN INTERVAL < £ 4 *1 » £4*( I + I ) ) 

WITH I EVENS OTHERWISE Y IS CONGRUENT TC 64-X (MOD 64) 
NONE 

X SHOULD NCT BE TOO LARGE OR EFFICIENCY SUFFERS 
SINGLE 
FORTRAN IV 


FUNCTION FOLD <4( X) 

F CLD64= ABS (X ) 

IF (FOLD 64 .LE.64 . ) RE TLFN 
1 FOLD 64= ABS(FOLD64- 1 2fl . I 
IF ( F0LD64 .GT .64 . ) GOTO 1 
PFTURN 
END 



